IT & Software

Python ETL Developer

Forestreet

London · England · United Kingdom

Our Mission is to democratise the global research industry by providing unbiased business intelligence through analysis of mass public data, using Machine Learning and NLP techniques. We have recently been acquired by Beroe, but have kept the 'startup feeling' within our team, which is now looking to grow.

Our Company values

About the role

The role will be part of a team to maintain and deliver the Backend ETL pipeline, which is built on a chain of Docker microservices, orchestrated by AWS Step Function and Kubernetes clusters. It involves a tight ETL process that sources data from APIs as well as scraping, before transforming via algorithmic as well as NLP means, with assistance provided by LLM, before data warehousing for consumption through APIs and our native SaaS platform. We work a 4-day week , with on-call every other Friday (business hours only).

Responsibilities:

  • Maintain and improve on the existing ETL services written in Async Python, as well as creating new services, ensuring discipline, robustness, speed and cost efficiency;
  • Work closely with Data Science and DevOps teams to architect and implement the delivery of new products; including the use of traditional NLP techniques involving Huggingface Transformers and Numpy matrices;
  • Warehousing data in organised and futureproof schemas on AWS S3, MySQL, DynamoDB, Neo4j or MongoDB, whichever most appropriate for its read-write pattern;
  • Use SQLAlchemy ORM and PyMongo to interface with data warehouses, and Pydantic for runtime schema validation;
  • Mentor junior members of the team, helping to upskill everyone;
  • Carry out code reviews.

Qualities/skills we are looking for:

  • Discipline : You value elegance and modularity in code, appreciate unit testing, static typing and documentation.
  • Self Driven : You have an autonomous, ownership-driven mindset, and are curious above all.
  • AI Capable, but not Reliant : You believe in the benefits and efficiency gains of pair programming with Coding assistants, but refuse to be enslaved by them. Instead you use them to get ahead of the game.
  • Teamwork : You are passionate to contribute knowledge for the benefit of the whole team, and in turn learn from and thrive alongside others.
  • API Expertise : You believe in the value of a RESTful interface, and strive to deliver well structured APIs for both internal and external consumption.
  • Passionate : You turn everything into a learning opportunity, driven by your passion to become a better developer everyday.
  • Architecture : You have a solid understanding of data architecture and software design, as well as in-depth knowledge of AWS or other major cloud platforms.
  • Business-minded : You can work with clients to clarify unclear or complex business requirements, come up with prototypes quickly, and iterate over improvements in order to create the final product.

Advice for applicants:

If you believe you are up for the challenge of being a Forestreeter, we have the following advice before you apply:

  • We do not believe in numeric years of experience - we care about how you think and build .
  • Github portfolio > CV – we love to see your Github . It does not need to be perfect – progression is what we want to see.
  • We value expertise outside of what we require above – whether it’s a different industry you came from, or a second programming language – they all contain value you can bring to the table.

Company Benefits

  • 4 day work-week (on-call every other Friday during business hours).
  • Hybrid working environment with two days per week in a well provisioned company office.
  • Pension plan and flexible benefits.
  • 20 days holiday per year.

Interview Process

  • Discovery call
  • First technical interview
  • Take-home task preceding second technical interview
  • Meet the team and leadership at our office in Farringdon / Chancery Lane
  • Values interview with Co Founders
  • Offer

We are a small team, and we insist on Engineers hiring Engineers : the interviewers are the same people you will be working alongside. However this may mean that we may not have lightning response time in the middle of a deployment!

#J-18808-Ljbffr

Reference: WJ-766_22244341

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.