Ecommerce Sales Data Pipeline
This project automated weekly vendor reporting by collecting e-commerce report data, converting raw JSON files into structured CSV reports, storing both raw and processed files in Amazon S3, and distributing scheduled report emails through Amazon SES.
The workflow reduced manual report handling and created a scalable foundation for future reporting expansion across multiple e-commerce platforms.

- Amazon EventBridge triggers the workflow on a weekly schedule.
- AWS Lambda retrieves API credentials securely from AWS Secrets Manager.
- The system authenticates with multiple e-commerce platforms and downloads reports in JSON format.
- A processing Lambda function automatically converts JSON files into structured CSV reports.
- Raw JSON files and processed CSV files are stored in Amazon S3 buckets.
- Amazon SES sends report emails to different user groups.
- Processed reports are automatically pushed to vendor FTP servers for integration with their internal systems.
- Automated weekly report generation and delivery.
- Stored raw JSON and processed CSV files in Amazon S3.
- Used DynamoDB to track report processing status.
- Delivered CSV reports through an SES email workflow.
- Amazon SP-API
- Walmart Marketplace
- Shopify



