Course Outline
Introduction to the Stratio Platform
- An overview of Stratio’s architecture and its core constituent modules
- The strategic role of Rocket and Intelligence throughout the data lifecycle
- Authentication processes and UI navigation within Stratio
Utilizing the Rocket Module
- Establishing data ingestion pipelines and workflow creation
- Linking data sources and configuring necessary transformations
- Employing PySpark for preprocessing operations within Rocket
PySpark Fundamentals for Stratio Users
- Core PySpark data structures and associated operations
- Application of looping constructs, including for, while, and if/else statements
- Development and application of custom functions using the def keyword
Advanced Integration of Rocket and PySpark
- Managing streaming ingestion and dynamic transformations
- Incorporating loops and functions in both batch and real-time processing scenarios
- Performance optimization best practices for PySpark pipelines
Investigating the Intelligence Module
- An examination of data modeling and analytical capabilities
- Processes for feature selection, transformation, and exploratory analysis
- The contribution of PySpark to custom analytics and insight generation
Constructing Advanced Analytics Workflows
- Development of user-defined functions (UDFs) within the Intelligence module
- Implementation of conditionals and loops for complex data logic
- Practical applications including segmentation, aggregation, and predictive modeling
Deployment and Team Collaboration
- Strategies for saving, exporting, and reusing established workflows
- Facilitating collaboration among team members within the Stratio environment
- Quality assurance of outputs and integration with downstream tools
Course Summary and Future Directions
Requirements
- Proficiency in Python programming
- A solid grasp of data analytics or big data processing principles
- Familiarity with Apache Spark and distributed computing concepts
Target Audience
- Data engineers managing Stratio-based infrastructure
- Analysts or developers leveraging the Rocket and Intelligence modules
- Technical teams adopting PySpark workflows within the Stratio ecosystem
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.