Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tiered ETL architectures.
- Creating modular and reusable components.
- Cross-system hybrid integration approaches.
Advanced Performance Engineering
- Optimization at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Implementing scripting within transformations.
- Creating custom plugins.
- Expanding PDI functionality using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming data integration.
- Interacting with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Protecting transformations and managing credentials.
- Establishing data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks.
- Designing for error recovery and failover.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Integrating PDI with Git.
- Patterns for continuous deployment.
Deployment, Monitoring, and Production Operations
- Migrating solutions across different environments.
- Utilizing operational tools and dashboards.
- Achieving end-to-end production readiness.
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling concepts.
- Practical experience with intermediate-level PDI transformations.
- Proficiency in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals overseeing complex data integration workloads.
Testimonials (1)
It's a hands-on session.
