Data Engineer
Kforce Inc

New York, New York

This job has expired.


RESPONSIBILITIES:

Kforce has a client that is seeking a Data Engineer in New York, NY.Summary:As a Data Engineer, you will be a part of an early stage team that builds the data transport, collection, and storage, and exposes services that make data a first-class citizen. We are looking for a Data Engineer to build a scalable data platform. Responsibilities:
  • Ownership of our core data pipeline that powers our top-line metrics
  • Use data expertise to help evolve data models in several components of the data stack
  • Help architect, building, and launching scalable data pipelines to support our growing data processing and analytics needs
  • Your efforts will allow access to business and user behavior insights, using huge amounts of data to fuel several teams such as Analytics, Data Science, Marketplace, and many others
  • You will report to a Data Engineering Manager
  • Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
  • Evolve data model and data schema based on business and engineering needs
  • Implement systems tracking data quality and consistency
  • Develop tools supporting self-service data pipeline management (ETL)
  • SQL and MapReduce job tuning to improve data processing performance


REQUIREMENTS:

  • 5+ years of relevant professional experience
  • 1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
  • Experience working on safety systems
  • Experience working with ADP Live Agent (not a must-have)
  • Strong skills in a scripting language (Python, Ruby, Bash)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • Comfortable working directly with data analytics to bridge Lyft's business goals with data engineering
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.


This job has expired.

More jobs for you in Recruitment Consultancy


Posted about 2 hours ago
Hotfoot Recruiters
Posted about 2 hours ago
Hotfoot Recruiters
Posted about 2 hours ago
Hotfoot Recruiters
View recent jobs »

New post from our employment blog

Diversity vs Inclusion: What's the Difference?

Diversity vs Inclusion: What's the Difference?

Sometimes, people confuse the two terms diversity and inclusion. But, it is important to know they are not synonymous. Diversity vs inclusion ...


Read full blog post
Share this inclusion job with the community

Click a community link below, and then social share the Data Engineer job.


Disability inclusion jobs logo
Asian inclusion jobs logo
Black inclusion jobs logo
Diversity inclusion jobs logo
LGBTQ inclusion jobs logo
Seniors inclusion jobs logo
Women inclusion jobs logo
Hispanic inclusion jobs logo