IT & Software

Data Engineer

TalentOla

Mississauga · Peel Region · Canada

Job Title: Data Engineer/ Python Developer

Experience: Minimum 9 years

Employment: Fulltime, 5 days onsite

Mandatory Skills: Python, Spark, Pyspark

Responsibilities

  • Design, develop, and maintain software solutions using Python.
  • Develop Python and pyspark programs for data analysis. Good working experience with Python to develop a custom framework for generating rules (similar to a rules engine).
  • Develop Python code to gather data from HBase and design a solution to implement using Pyspark. Apache Spark DataFrames/RDDs were used to apply business transformations and utilize Hive Context objects to perform read/write operations.
  • Develop back‑end services, APIs, and integrate databases.
  • Optimize applications for performance, security, and maintainability.
  • Troubleshoot and resolve software defects and issues.

#J-18808-Ljbffr

Reference: WJ-291_9350297

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.