Data Engineer
Astreya · San Ramon, California, US
- Years of experience: 5 to 10 years Focus: Reliability, Automation, and Data Quality. The Engineer turns the architect's blueprint into a working, automated...
Job description
Focus: Reliability, Automation, and Data Quality. The Engineer turns the architect's blueprint into a working, automated reality. - Years of experience: 5 to 10 years Key Responsibilities: - Build and maintain ETL/ELT pipelines to move data from source to storage. - Implement automated data quality testing and observability alerts. - Optimize data storage formats (e.g., Parquet, Delta Lake) for high-speed querying. - Manage CI/CD pipelines for data code deployment. - Create interactive visualizations with actionable insights by persona - Deliverables: Production-ready optimized data pipelines, Cleaned datasets, interactive & intelligent dashboards. - Tech Stack - AWS - Data Ingestion & Processing : AWS API Gateway, AWS Lambda, AWS Glue ETL, AWS Glue Crawler - Data Storage & Analytics : Amazon S3, Amazon Redshift (Data Warehouse), Amazon Athena - Governance & Security : AWS Lake Formation, AWS IAM, AWS CloudTrail, Amazon CloudWatch - AI & Analytics : AWS Bedrock - Visualization : Amazon QuickSight - Visa Requirement: USA Work Visa - H1B / H4 with EAD with a minimum validity of 2 years Salary Range: $132,240.00 - $208,800.00 USD (Salary) Astreya offers comprehensive b enefits to all...