Lead Data Engineer in NY Job at Vertex Elite LLC, New York, NY

QmpGaUlwMDdsVktJc3JXbitxM1k4WEdSVEE9PQ==
  • Vertex Elite LLC
  • New York, NY

Job Description

Location: New York City, NY; (Onsite 5 days/week)

Duration: Long Term Contract

Tech skill sets: Data Architecture, Data Modelling, Expert level SQL, Python, AWS Technologies (Glue), Snowflake and data engineering design patterns

Domain: Asset management, Alternatives Investments, Financial Services.

About the Role:

We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains.

Key Responsibilities:

  • Lead the data architecture and engineering strategy , ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions .
  • Performance Optimization: Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance: Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication: Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation: Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution: Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.

Required Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 10+ years of experience in data engineering with a strong focus on Data Architecture , Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL/ELT tools.
  • AWS Technologies (Glue, EMR)
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.

Preferred Qualifications:

  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).

Job Tags

Long term contract,

Similar Jobs

Supercuts

Hair Stylist Job at Supercuts

 ...Supercuts is Hiring Hair Stylists! Do What You Love. Love What You Do. Our salon is looking for talented hairstylists who are passionate...  ...salon team. Location Information: 5194 Commons Drive, Ste 106, Rocklin, CA 95677 JOIN THE TEAM TODAY! Apply Online:... 

AIG

Apple Tier 2 Operations Support Specialist (Customer Service) Job at AIG

 ...Insurance is a leading provider of insurance products and services for commercial and personal insurance customers. It includes one of the worlds most far-reaching...  ...Support Specialist will work directly with Apple warranty customers, Apple, and our internal partners... 

Philips

Global Sales Training and Enablement Leader, Healthcare Informatics (Cambridge MA) Job at Philips

JOB DESCRIPTION Job Title Global Sales Training and Enablement Leader, Healthcare Informatics (Cambridge MA) Job Description Design and deploy a global sales training and enablement strategy to accelerate growth in the Philips Healthcare Informatics business... 

CMTA, Inc.

Mechanical Engineer Intern/Co-op Fall 2026 - CMTA Job at CMTA, Inc.

 ...CMTA, a Legence Company CMTA is one of the fastest growing engineering firms in the U.S., with nationally recognized expertise in...  ...has a robust co-op program for students pursuing a degree in Mechanical Engineering, Electrical Engineering, and Architectural Engineering... 

MVP Health Care

Digital Content Manager Job at MVP Health Care

 ...future for everyone which requires innovative thinking and continuous improvement. To achieve this, were looking for a Digital Content Manager to join #TeamMVP. If you have a passion for creating engaging digital experiences, optimizing content for performance, and...