Role : Software Engineer - Data
We are seeking a highly experienced Engineer to join our team and own the development of a Tiered data architecture for our data. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless dataintegration and enable the delivery of high-quality insights to our leadership and business stakeholders. Skills
Required : Apache Spark, SQL, git, Programing Language (Python, Java, Scala)
Nice to have : Understanding of Design Patterns, Able to discuss tradeoffs between RDBMS vs Distributed Storage Key Qualifications
- Proven experience in data engineering, data architecture, or a related field
- Experience in building and deploying tiered data architecture for analytics data is a plus
- Strong understanding of data modeling, data warehousing, and ETL concepts
- Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop or Spark
- Experience with data orchestration tools like Airflow is a nice to have
- Excellent problem-solving and analytical skills, and the ability to work well under tight deadlines
- Excellent interpersonal skills and the ability to collaborate effectively with cross-functional teams Description
- Design and implement a tiered data architecture that integrates analytics data from multiple sources in an efficient and effective manner.
- Develop data models and mapping rules to transform raw data into actionable insights and reports.
- Collaborate with the analytics and business teams to understand their requirements and deliver solutions that meet their needs.
- Ensure data quality and accuracy by developing data validation and reconciliation processes.
- Play an active role in the development and maintenance of user documentation, including data models, mapping rules, and data dictionaries.
- Collaborate with multi-functional teams to define and implement data governance policies and standards.
- Stay informed about the latest developments in data analytics and data management technologies and recommend new tools and methodologies to improve the semantic layer.
Work Location with ZIP: Austin-TX-78753
Is remote work an option?: No
If remote work, please indicate how many days are required to be in the office and remote: 3 days in a week required to be in the office
Chance to be perm?: Yes
Performance Expectations:
Technical Hiring Criteria (Must Haves)
• Top 3 Required skills: Spark, Scala, SQL
• Years of experience in each of the must-have skills: 7+ Years
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.