Weekday, Inc. Logo

Weekday, Inc.

Software Engineer (Open Source Contributor)

Posted 6 Days Ago
Remote
Hiring Remotely in United States
50-100 Hourly
Entry level
Remote
Hiring Remotely in United States
50-100 Hourly
Entry level
Develop and evaluate coding tasks for AI systems, including bug fixes, feature development, refactoring, optimization, reproducible environments, reference solutions, automated testing, and deterministic evaluation. The role also involves debugging complex codebases, reviewing contributions, documenting technical decisions, and refining evaluation criteria. Candidates should have strong software engineering fundamentals, backend or API development experience, open-source contributions, and proficiency in at least one listed programming language.
The summary above was generated by AI

This role is for one of our clients

Pay: 50–100/hour

Role Type: Contractor

Location: Anywhere in the world, remote

Estimated Time Commitment: Approximately 15 hours per task run

Start Timeline: Within 24–48 hours of onboarding

We are seeking experienced Software Engineers and Open Source Contributors to help develop and evaluate next-generation AI systems through high-quality software engineering tasks. This opportunity is ideal for developers with strong programming fundamentals, practical experience contributing to open-source projects, and a proven ability to solve complex engineering problems.

In this role, you will design realistic, challenging, and reproducible coding environments that assess an AI model's ability to fix bugs, implement new features, refactor existing code, and optimize software performance. You will also develop reliable verification mechanisms and golden reference solutions to evaluate whether AI-generated code meets the specified requirements.

Prior experience in artificial intelligence is not required. Your software engineering expertise, code quality standards, debugging skills, and open-source contributions will be central to the role.


Requirements

Key Responsibilities

  • Coding Task Development: Create realistic, technically challenging programming tasks involving bug fixes, feature development, code refactoring, and performance optimization.
  • Reproducible Environment Setup: Build deterministic reinforcement learning environments with the necessary dependencies, test suites, configurations, and execution instructions.
  • Reference Solution Implementation: Develop reliable golden reference solutions that demonstrate the expected behavior and satisfy all task requirements.
  • Automated Verification: Design deterministic evaluators and test cases that accept valid implementations while rejecting incorrect, incomplete, or non-compliant solutions.
  • Software Debugging: Investigate complex software defects, troubleshoot unexpected behavior, and resolve performance bottlenecks across diverse codebases.
  • Feature Engineering: Implement robust and scalable features while following established software development principles and coding standards.
  • Code Refactoring and Optimization: Improve existing codebases by enhancing readability, maintainability, execution efficiency, and long-term reliability.
  • Code Review and Validation: Review code contributions and technical submissions for correctness, clarity, performance, and adherence to best practices.
  • Technical Documentation: Document problem statements, implementation decisions, debugging strategies, testing procedures, and solution reasoning to support high-quality AI training and evaluation.
  • Continuous Improvement: Refine tasks and evaluation criteria based on observed model behavior and identified weaknesses.

Required Qualifications

  • Strong software engineering experience in one or more programming languages, including Python, Java, C++, Go, Rust, or TypeScript.
  • Demonstrated experience developing backend systems, scalable services, APIs, or complex software applications.
  • A clear track record of open-source contributions, preferably supported by a GitHub profile or equivalent public portfolio.
  • Strong understanding of data structures, algorithms, software design principles, and debugging techniques.
  • Practical experience with automated testing, code validation, and software quality assurance.
  • Ability to identify and resolve complex bugs, implementation errors, and performance bottlenecks.
  • Experience developing new features and improving existing codebases.
  • Strong analytical thinking, problem-solving, documentation, and technical communication skills.
  • Ability to work independently, follow detailed technical specifications, and deliver reproducible, verifiable solutions.
  • Interest in AI systems and understanding how software engineering expertise can support AI model training and evaluation.

Must-Have Skills

  • Software Engineering
  • Open Source Contributions
  • Backend Development and API Design
  • Python, Java, C++, Go, Rust, or TypeScript
  • Debugging and Troubleshooting
  • Data Structures and Algorithms
  • Automated Testing and Code Validation
  • Code Review and Refactoring
  • Performance Optimization

Good-to-Have Skills

  • Experience with large-scale or legacy codebases
  • Reinforcement Learning Environment Development
  • Deterministic Testing and Automated Evaluation
  • CI/CD and Development Tooling
  • Scalable Distributed Systems
  • Performance Profiling and Optimization
  • Complex Feature Implementation
  • AI Model Evaluation and Coding Agent Assessment
  • Public GitHub repositories or notable open-source projects

Opportunity Snapshot

  • Time Commitment: Approximately 15 hours per task run, depending on complexity and individual workflow.
  • Flexible Schedule: Work with flexibility while meeting task requirements and weekly submission minimums.
  • Getting Started: Selected candidates receive onboarding instructions and the resources required to begin.
  • Portfolio Requirement: A public GitHub profile or another portfolio demonstrating relevant open-source contributions is preferred.
  • Alternative Assessment: Candidates whose public portfolios do not sufficiently demonstrate their skills may be required to complete a HackerRank technical assessment.
  • Compensation: Payment is based on completed tasks that meet the specified quality and acceptance criteria.

Selection Process

  1. Application: Submit your application and complete the initial screening questions.
  2. AI Interview: Complete an approximately 20-minute interview focused on your technical experience and problem-solving approach.
  3. Technical Assessment: Complete a HackerRank assessment if your portfolio does not adequately demonstrate the required expertise.
  4. Hiring Manager Review: Your application, technical capabilities, and assessment results will be reviewed.
  5. Onboarding: Selected candidates receive onboarding materials and instructions for beginning their assignments.

Candidates are expected to complete interviews and assessments independently so their technical judgment and problem-solving abilities can be evaluated accurately.

Expected Availability

The selection process may move quickly, with positions often filled within approximately 48 hours. Successful candidates should be prepared to begin their first tasks within 24–48 hours after completing onboarding.

Similar Jobs

Yesterday
Remote
Expert/Leader
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Manages indirect material planning, procurement coordination, inventory accuracy, tooling orders and maintenance, and WIP management for semiconductor assembly and test operations. Drives manufacturing improvements through AI, automation, dashboards, and real-time issue resolution. Maintains process documentation, supports quality and regulatory compliance, and collaborates cross-functionally to improve production flow and achieve operational KPIs.
Top Skills: Artificial IntelligenceAutomationDashboardsData Visualization SoftwareMesSAP
Yesterday
Remote
Mid level
Mid level
Events • Food • Travel • Hospitality • Hotels & Resorts
Develop and execute hotel marketing strategies across digital, social, and branded channels to increase visibility, revenue, and guest engagement. Monitor industry trends, coordinate cross-functional campaigns, analyze performance, conduct market research, and present monthly marketing updates to Sales and Revenue Management teams.
Top Skills: Email MarketingOnqSalesforceSemSeoSocial Media
Yesterday
Remote or Hybrid
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Provides technical leadership for embedded platform software and avionics certification. Develops BSPs, boot software, platform abstraction layers, device drivers, middleware, requirements, architecture, and DO-178C certification documentation. Leads certification activities, solves complex technical issues, collaborates with stakeholders, supports talent development, and drives software quality and continuous improvement. Requires extensive real-time embedded software experience in C, C++, assembly, bare-metal environments, multicore systems, and Deos RTOS.
Top Skills: Arinc 429ArmAssemblyBare-MetalBoard Support PackagesCC++Deos RtosDevice DriversDo-178CEthernetMiddlewareMulticore SystemsNetwork Communication StacksPowerpcRs-232Rs-422X86

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account