Senior Member of Technical Staff - Web Data (Pre-training)
Benefits
6w PTO
26w maternity
26w paternity
Similar Jobs
See allSenior Member of Technical Staff, Synthetic Data
Cohere
Global
Python
LLMs
Apache Spark
Software Engineer, Data Infrastructure
Cohere
Global
Python
Kubernetes
Apache Spark
Senior Engineer (Python)
Tekmetric
Python
Web Scraping
Data Processing
Staff Data Engineer
Webflow
United States
Spark
Kafka
SQL
Data Engineer
Wynd Labs
Global
Python
Web Scraping
Data Warehousing
Key Responsibilities:
- Maintain large-scale pipelines for processing web corpora.
- Work on filtering and quality-scoring systems to identify high-value web documents.
- Analyze web data composition across domains, languages, and time periods.
Qualifications:
- Strong software engineering skills with proficiency in Python and experience building data pipelines.
- Familiarity with data processing frameworks such as Apache Spark, Apache Beam, or Pandas.
- Experience working with large-scale web datasets and knowledge of data quality assessment.
Perks and Benefits:
- Full health and dental benefits, including a separate budget for mental health.
- 100% Parental Leave top-up for up to 6 months for either parent.
- 6 weeks of paid vacation (30 working days), plus annual enrichment benefits.
Cohere
Cohere is a leading security-first enterprise AI company that builds cutting-edge foundation models and end-to-end products. The company is a global team of researchers, engineers, and designers passionate about AI, headquartered in Toronto with offices in major cities worldwide.