Remote Senior Data Platform Engineer

Description:

• Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for various financial instruments including stocks, ETFs, options, crypto, and fixed income.
• The company has raised over $170 million in funding to support its growth and vision.
• Alpaca serves hundreds of financial institutions across 40 countries with institutional-grade APIs, totaling over 6 million brokerage accounts.
• The team is composed of over 230 globally distributed members who work remotely from various countries.
• The Senior Data Engineer will design and develop the data management layer for the platform to ensure scalability for larger customers and new jurisdictions.
• Responsibilities include processing hundreds of millions of events daily, overseeing data ingestion, transformation, and consumption layers, and managing data experimentation and monitoring systems.

Requirements:

• Candidates must have 7+ years of experience in data engineering, including 2+ years of experience building scalable, low-latency data platforms capable of handling over 100 million events per day.
• Proficiency in at least one programming language is required, with strong working knowledge of Python and SQL.
• Experience with cloud-native technologies such as Docker, Kubernetes, and Helm is necessary.
• Strong hands-on experience with relational database systems is essential.
• Candidates should have experience in building scalable transformation layers, preferably using formalized SQL models like dbt.
• The ability to work in a fast-paced environment and adapt solutions to changing business needs is required.
• Experience with ETL technologies like Airflow and Airbyte is necessary.
• Production experience with streaming systems such as Kafka is required.
• Exposure to infrastructure, DevOps, and Infrastructure as Code (IaaC) is necessary.
• Deep knowledge of distributed systems, storage, transactions, and query processing is essential.

Benefits:

• The position offers a competitive salary and stock options.
• Health benefits are provided to employees.
• A one-time home-office setup allowance of USD $500 is available for new hires.
• Employees receive a monthly stipend of USD $150 via a Brex Card.