Data Engineer
About GovConnex
GovConnex is a rapidly growing Australian technology company, established in 2019, revolutionising the public affairs landscape. Our software serves a wide array of organisations, from listed companies to small nonprofits, enhancing their interactions with the government. As a multidisciplinary team, we are dedicated to providing exceptional information and workflow tools that empower our customers to effectively engage with government and influence public policy. Having become the market leader in Australia, we are now poised to expand our reach into global markets.
Engineering at GovConnex
Our culture prioritises excellence and efficiency. We dislike long meetings, in favour of asynchronous communications like Slack. Flexibility is abundantly available as long as results are met. With a very flat structure, all engineers are encouraged to suggest improvements or drive their own projects.
We have a hybrid work-from-home model. We support staff to either be fully remote if not Sydney-based, or a 3/2 hybrid of working from home/coming to the office.
We take pride in our commitment to developing high-quality software, leveraging cutting-edge tools and technologies to address challenges and continually improve our platform and skills.
The Role
As a Data Engineer, you will be responsible for our scraping infrastructure and codebase. Tasked with creating and maintaining thousands of scrapers, you will maintain our proprietary suite of technologies and tools, along with creating additional tools to continuously improve the process.
A successful candidate will be comfortable with a good amount of self-direction and feel confident in communicating with a diverse group of team members.
Your responsibilities will include:
- Developing, optimising, and maintaining web crawlers and scrapers using the Scrapy framework
- Collaborating with the rest of the business to refine our scraping and data acquisition processes
- Integrating APIs and third-party data sources to enhance the functionality of our platform
- Ensuring the scalability, stability, and performance of our backend systems to handle large amounts of data
- Participating in code reviews and contributing to the team's continuous improvement efforts
- Troubleshooting and resolving issues related to web scraping, data extraction, and data processing
Required Qualifications/Experience:
- 5+ years of commercial experience in software development
- Experience creating scrapers/spiders
- Proficiency in Python
- Excellent communication skills
- Proficiency in English
Preferred Qualifications/Experience:
- Familiarity with the Scrapy framework
How to Apply
Please email your application to Paul at [email protected], including the job title in the subject line, along with your CV and/or LinkedIn profile link. In a few sentences, kindly provide the following information:
- Why you’re interested in working at GovConnex
- What your ideal role looks like
- Anything else we should know about you
GovConnex is an equal opportunity employer, committed to merit-based recruitment and promotion, irrespective of sex, race, marital status, sexual preference, or religion. We strive to cultivate a diverse workforce, encompassing a wide range of talents to help us achieve our objectives.