**Job Posting: Developer for Cloud Application**
**Overview:**
Join our dynamic team as a Developer, where you’ll be crucial in managing and enhancing an application hosted on Amazon Web Services and Google Cloud Services. This role is vital for maintaining our high-performing application, integral to data analysis and visualization in the e-commerce domain, with a focus on leveraging powerful tools like BigQuery for data processing.
**Key Responsibilities:**
– Manage the application’s infrastructure using AWS CloudFormation and Google Cloud Deployment Manager for Infrastructure as Code (IaC).
– Oversee compute processes utilizing AWS Lambda, ECS, and Google Cloud Functions.
– Handle raw data storage with Amazon S3 and Google Cloud Storage, manage data ingestion using Postgres.
– Utilize DBT for data modeling, with a focus on integration within Google BigQuery for advanced data analysis.
– Conduct dynamic orchestration and scheduling via SQL queries for data accuracy and completeness in AWS and Google Cloud environments.
**Current Application Functions:**
– Authenticate brands using Amazon Seller Central Selling Partner API (SP-API) and Amazon Advertising API, with potential integration of Google services.
– Initiate schema creation for brands, triggering data flow into our system, and utilizing Google BigQuery for scalable analytics.
– Store all data initially in Amazon S3 and Google Cloud Storage, with pre-storage JSON transformation functions.
– Transfer data from cloud storage to PostgreSQL in an AWS RDS or Google Cloud SQL environment, maintaining a schema-per-tenant architecture.
– Flexibly create new data sources, including automated cloud storage bucket and schema table creation for new API endpoints.
– Ensure robust data analysis and visualization capabilities, focusing on data accessibility, completeness, and historical accuracy across cloud platforms.
**Candidate Profile:**
– Expert in Python and PHP/Laravel with a strong background in GitHub usage and documentation creation for engineering teams.
– Proficient in Amazon Selling Partner API and Amazon Advertising API; familiarity with Google Cloud Services (GCS) and BigQuery is required.
– Experience with other online marketplace APIs (e.g., Walmart, eBay, Shopify) is a plus.
– Comfortable with various aspects of Data Engineering, from data lakes to traditional databases, across multiple cloud platforms.
– Experienced in Infrastructure as Code (IaC) using both AWS CloudFormation and Google Cloud Deployment Manager.
– Skilled in troubleshooting applications across AWS and Google Cloud platforms.
– Possesses a natural curiosity for problem-solving and a passion for exploring new technologies.
**Join Us:**
If you’re ready to take on a challenging yet rewarding role in a cutting-edge technological environment, we would love to hear from you. Apply now to become a pivotal part of our team’s success!
APPLY FOR THIS JOB:
Company: wrksourcing
Name: James Gossling
Email: