Data Pipeline Orchestration with Dagster

Context

The growth of analytical infrastructure and the need to integrate data from multiple complex transactional sources (such as ERPs on SAP HANA and storage and logistics systems on SQL Server / Intralog) required a centralized, auditable, and resilient system.

To solve this, the old model of cron tasks and isolated scripts was migrated to a data architecture fully orchestrated with Dagster at Vinos América, structured through independent gRPC microservices coordinated by Docker containers.