Engenheiro de Dados Sênior

Job Description

Join Stefanini as a Senior Data Engineer and play a crucial role in developing and maintaining efficient, scalable data pipelines for structured and unstructured data. You'll design and implement solutions for storing and processing large volumes of data. Work with relational, non-relational (SQL and NoSQL), and vector databases to support RAG architectures. Ensure data quality and integrity throughout the processing flow. Implement ETL/ELT processes to transform raw data into useful information for LLM training and consumption. Collaborate with data scientists and analysts to understand requirements and create customized solutions. Monitor and optimize the performance of data systems. Ensure security and compliance with data protection regulations.

Qualifications

1. Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related fields. 2. Proven experience in programming (Python, Java, Scala, etc.). 3. Solid experience in high-volume distributed processing with Apache Spark or Apache Beam. 4. Experience with workflow orchestrators (Airflow, Dagster, or Prefect). 5. Knowledge of relational databases (MySQL, PostgreSQL, Oracle, SQL Server). 6. Experience with cloud environments (AWS, Azure, Google Cloud). 7. Ability to work with APIs and data integration. 8. Experience with version control (GitHub). 9. Knowledge of data modeling and Data Lake or Data Warehouse architectures. 10. Experience with data quality applications for data processing. 11. Experience with open storage formats (Delta Parquet, Iceberg) and knowledge of Features. **Bonus Points:** * Certifications in Big Data or Cloud Computing tools. * Experience working with BI tools and data visualization. * Knowledge of NOSQL databases (MongoDB, Cassandra, Neo4J). * Experience with GCP data services (Cloud Run, DataProc, BigQuery). * Knowledge of Data Masking and PII Redaction techniques for compliance and security in AI models. * Fluent Spanish or English.

Benefits

- Meal voucher or food voucher. - Discounts on courses, universities, and language institutions. - Stefanini Academy — platform with free, updated online courses and certificates. - Mentoring. - Advantage club for consultations and exams. - Medical assistance. - Dental assistance. - Advantage and discount club at the best establishments. - Travel club. - Pet care plan.