Description:

Tekmetric is a cloud-based auto-repair shop management system focused on customer care and service.
The company is seeking a Software Engineer with expertise in web scraping, data processing, and search technologies.
The role involves building a large-scale data ingestion and classification system.
Responsibilities include extracting data from various sources such as web pages, APIs, and PDFs, cleaning and normalizing data, and building search capabilities using ElasticSearch/OpenSearch.
The engineer will work with technologies including Python, Scrapy, Airflow, Kubernetes, AWS, and Spark to create scalable data pipelines.
Key tasks include designing distributed crawling bots, developing data pipelines, unifying documents into a coherent data schema, preprocessing raw data, building APIs, collaborating with ML/NLP teams, automating workflows, and optimizing data pipelines.

Requirements:

Candidates must have 3+ years of experience in Python, specifically in building crawling/scraping solutions at scale.
Experience with APIs (REST) and PDF processing (OCR, Tesseract, PyMuPDF) is required.
Proficiency in data processing and search technologies such as ElasticSearch/OpenSearch and NoSQL/SQL databases is necessary.
Hands-on experience with Airflow and Spark (EMR) or similar distributed systems is essential.
Strong problem-solving skills in handling anti-scraping mechanisms and data scaling challenges are required.
Candidates should have hands-on experience with AWS or GCP.

The position offers flexible and remote work opportunities.
Employees receive generous PTO and exceptional leave programs for various life events, including maternity, paternity, and medical leave.
Comprehensive healthcare coverage including Medical, Dental, Vision, and Prescription Drug Coverage is provided.
Financial benefits include a 401(k) Retirement Savings Plan with a 6% match, employer-covered STD, LTD, Life, and AD&D Insurance Programs.
Employees can receive up to $60 monthly for wellness expenses and activities, as well as education assistance for undergraduate/graduate courses and continuing education.
The company promotes a positive work environment with a stellar team, a cool office, and fun activities.