WayneRecruiter Since 2001
the smart solution for Wayne jobs

Technical Data Engineer

Location: Wayne
Posted on: August 2, 2020

Job Description:

The Technical Big Data Engineer plays a critical role in the following areas: Ingesting, transforming, storing and analyzing data in Cloudera''s CDH Big Data Platform environment to support the bank''s strategic business goals; Working in a development team and with other teams across the SDLC phases to ensure Valley National Bank''s specific standards, procedures and methodologies are adhered to in support of the bank''s strategic business goals. Responsibilities include but are not limited to: Build scalable databases for the consumption of structured and unstructured data, work with external data providers to maximize competitor data throughout Valley National Bank. Import and export data between an external RDBMS and the Hadoop Cloudera cluster, including the ability to import specific subsets, change the delimiter and file format of imported data during ingest and alter the data access pattern or privileges. Automate data pipelines from various systems to create advanced analytics and Machine Learning. Ingest real-time and near real time (NRT) streaming data into HDFS, including the ability to distribute to multiple data sources and convert data from on ingest from one format to another. Convert data from one file format to another, Evolve an Avro or Parquet schema for performance optimization. Develop RESTful web services. Write query to filter data or to join multiple data sets. Agile project methodology and waterfall where required. Required Skills: Solid track record of data integration showing excellent execution and attention to detail. Programming experience ideally in Spark and a willingness to learn new languages to meet goals and objectives. Experience in Python, Kafka, Java, C, Perl, Javascript or other programming languages is a plus. Experience in SQL, MySQL and SQL Server databases. Experience in MapReduce is a plus. Knowledge of data mining, machine learning, natural language processing or information retrieval. Knowledge of integration concepts as they relate to sourcing data from disparate sources. Experience in a cloud environment (MS Azure preferred). Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources. Knowledge of Data warehousing best practices for optimal performance in an MPP environment. Experience with Apache Avro and Apache Parquet. Experience with Impala with Kudo (interactive SQL). Experience with BI Visualization tools like MS PowerBI. Experience with test automation and QA. Knowledge of Machine Learning and Computational Statistics. Ability to communicate both verbally and written to employees in the business units utilizing non-technical language. Willingness to explore new alternatives or options to solve data integration issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done. Experience in production support and troubleshooting. Ability to learn to create a data-driven culture and impactful data strategies. Required Experience: B.S in computer science or a related IT degree with a minimum of 2 years of big data engineering experience. Working with Big Data projects. Must have experience developing and integrating solutions for Big Data Platforms, including Azure. Financial Services, Retail Banking, Credit Card data or related domain / industry experience of at least 2 years. Cloudera Pig, Sqoop, HIVEW, MapRedue, Scala, Spark, Trifacta, etc. Cloud (Azure/AWS) experience preferred. Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabledby Jobble

Keywords: VALLEY BANK, Wayne , Technical Data Engineer, IT / Software / Systems , Wayne, New Jersey

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other IT / Software / Systems Jobs

Oracle CC&B Developer
Description: Job Title Oracle CCB Developer Location NYC, NY Remote until Covid Duration 6-12
Company: Apolis
Location: New York
Posted on: 08/10/2020

Azure Developer - Azure Architect at NJ & CA
Description: Position Role Sr. Azure Developer Location New JerseySanta Clara, CA Duration Long term Rate 70 per hour C2C No of positions 4 Experience Level 8-10 Yrs Responsibility The client engineering team is looking (more...)
Company: Logic Soft, Inc.
Location: Iselin
Posted on: 08/10/2020

Python Developer
Description: INCORPORAN INC is looking for Strong Python Developer for our client in New York, NY Title Python developer Location New York, NY and NC Duration Long term Project Job Type Contract EXP 10 Interviews (more...)
Company: Incorporan Inc
Location: New York
Posted on: 08/10/2020

Cybersecurity, Technology Risk, and Privacy Manager
Description: Cybersecurity, Technology Risk, and Privacy Manager br br br br br br br br Opportunity ID br br 2436 br br br br Department s br br br br Assurance br br br (more...)
Company: CohnReznick
Location: Roseland
Posted on: 08/10/2020

Full stack Java developer with Scala
Description: If you have anyone who has 7-10 years
Company: ARMO Consultants
Location: New York
Posted on: 08/10/2020

Internship in Information Technology (IT)
Description: Are you interested in an entry-level information technology IT internship br Year Up is a one-year, intensive program that provides young adults with hands-on skill development, corporate internships, (more...)
Company: Year Up
Location: Brooklyn
Posted on: 08/10/2020

Lead PHP Developer
Description: Logisoft Technologies, Inc is a global information Technology, Consulting and Services company with more than 100 satisfaction rating from all the clients across USA. Logisoft was established with a commitment (more...)
Company: Logisoft Technologies Inc
Location: Fairfield
Posted on: 08/10/2020

ReactJS / Angular Developer for Equity Derivatives Group paying up to 1100/per day Corp
Description: A Top Investment Bank is looking for a Strong Front-end Developer ReactJS AngularJS with solid Server-side C or Java Server-side a huge plus . This role is in the Equity Derivatives group and has solid (more...)
Company: Archer I.T., LLC
Location: New York
Posted on: 08/10/2020

Software Engineer (Skill Level 1) - $10K sign on eligible
Description: Job Description This job may be eligible for a 10K sign on bonus for external hires At Lockheed Martin Rotary and Mission Systems, Cyber Solutions, we are driven by innovation and integrity. We believe (more...)
Company: Lockheed Martin
Location: New York
Posted on: 08/10/2020

SMTS - Sys Anly and Prog
Description: What you'll be doing Our customers rely on us for the best network and customer experience. You will be responsible for helping to grow and optimize our multi-modal Artificial Intelligence Automation (more...)
Company: Verizon
Location: Livingston
Posted on: 08/10/2020

Log In or Create An Account

Get the latest New Jersey jobs by following @recnetNJ on Twitter!

Wayne RSS job feeds