Clear Filters

Web crawling Jobs

77 Jobs

Most Relevant

77 web crawling Jobs

  • 3.2
    Payer Compass
    Sr .NET Software Engineer
    Plano, TX
    $89,133 - $179,659 (Glassdoor est.)
    Easy Apply
    from a variety of source types starting from web crawling/scraping to PDF deconstruction Develop unit and system tests for code developed by self and others Produce…
  • Data Engineer
    South Bend, IN
    $53,684 - $104,500 (Glassdoor est.)
    Easy Apply
    Experience working with relational database structures, SQL and/or flat files and performing table joins, web crawling, and web
  • SENIOR SOFTWARE ENGINEER - Web Crawling (Austin/Remote)
    Austin, TX
    $83,908 - $141,062 (Glassdoor est.)
    Easy Apply
    SENIOR SOFTWARE ENGINEER, Web Crawling Architecture, $160K-$180K, Austin/Remote About the company Datafiniti was founded with the vision of making every kind of data immediately accessible to anyone that needed it…About the role We wish to hire an experience software engineer who has a strong passion for developing highly-scalable distributed systems, particularly around web crawling or web scraping…
  • Morningstar Logo4.1
    Associate Software Engineer
    Woburn, MA
    $75,900 - $133,417 (Glassdoor est.)
    ’ ability to crawl web sites, and extract financial information. …, HTML, JavaScript, Flash, PDF, and web services. …
  • Data Engineer
    Rockville, MD
    $64,625 - $132,663 (Glassdoor est.)
    Easy Apply
    Build large-scale batch and real-time data pipelines with data processing frameworks like Storm, or Spark and ingestion solutions such as Kafka or Kinesis on the Amazon Web…Experience with data ingestion via API and/or web
  • Diffbot Logo4.6
    Software Engineer, Full-Stack
    Menlo Park, CA
    $82,052 - $192,046 (Glassdoor est.)
    Easy Apply
    Work with cross-functionally with the product and growth teams on product definition, and optimizing product usability Become an expert on data extraction, web crawling, and Diffbot product offerings…Responsibilities Full-stack web development on the customer-facing production dashboard: implementing new features, fixing bugs, and testing…
  • Finicity Logo4.5
    Full Stack Developer
    Salt Lake City, UT
    $56,750 - $129,924 (Glassdoor est.)
    Easy Apply
    / web crawling Familiarity with CI/CD tools like Gitlab or Jenkins Source control (Git…
  • Amazon Dev Center U.S., Inc. Logo3.8
    Software Development Engineer Performance Benchmarking
    Seattle, WA
    $89,552 - $162,876 (Glassdoor est.)
    scripting, web crawling and cloud platform CLIs and SDKs Strong documentation, workflow diagraming and reporting skills…
  • The Shelf Logo3.4
    Full Stack Engineer
    Brooklyn, NY
    $72,004 - $137,322 (Glassdoor est.)
    : ReactJS Python Django Web-crawling Database query optimizations JavaScript High Level At a high level…Front-end Experience Absolute mastery of HTML/CSS/JavaScript for web-based applications to build UI…
  • Customer Success & Solutions Engineer (Austin/Remote)
    Austin, TX
    $41,911 - $88,606 (Glassdoor est.)
    Easy Apply
    Your work will give you exposure to virtually all aspects of our operations - including web crawling, data analysis, API functionality, and more…. - Leading or assisting in implementation of specific customer requests, such as new web crawls, improving data quality, or prototyping new API features - Supporting our sales team with prospective…
  • Cisco Systems Logo4.3
    Software Engineer, Webex Graph
    San Jose, CA
    $111,075 - $177,581 (Glassdoor est.)
    Top Company
    To do this we tackle problems like - How do you decide which parts of the web to crawl…We’ve built a proprietary data platform that scours billions of pages on the web and uses…
  • 4 Corner Resources Logo4.1
    Technical SEO Specialist
    Madison, WI
    Easy Apply
    development.Responsibilities of the Technical SEO Specialist Conduct SEO audits by analyzing outputs from reporting tools to uncover issues related to web crawling, JavaScript rendering, etc…, Google Tag Manager, Google Search Console, Tableau, Excel, Screaming Frog, and Deep Crawl
  • Services LLC Logo3.8
    Software Development Engineer
    Manhattan Beach, CA
    $84,697 - $160,533 (Glassdoor est.)
    , or C AmazonBot is a smart, fast and polite Web crawling service, that is constantly learning about the Web and passing collected information to customers exploring Web content…Our crawler is smart, in that, it understands and organizes the crawled Web content to provide Amazon wide organizations fresh, relevant data required to improve…
  • BioUrja Power, LLC Logo4.6
    Python Developer - Houston, TX
    Houston, TX
    $58,784 - $123,785 (Glassdoor est.)
    Easy Apply
    Also be able to write modular code and understand the python packaging system.  Experience on web crawling, scraping… (Scrapy,BeautifulSoup, Selenium) and web application development using Django/Flask Framework.  Experience on Data-Science; exposure to Theanos, Tensorflow, Pytorch…
  • Fidelity Investments Logo4.2
    Principal Text Search Engineer-SOLR/ Lucidworks
    Boston, MA
    $94,620 - $156,631 (Glassdoor est.)
    and/or NLP a plus Knowledge in setting up spiders to crawl web sites Knowledge working with Python and R libraries Knowledge in Web Scraping, extracting text…Experience in Pattern Matching to extract data from Web Sites (Web Scraping…
    Software Developer (Systems Software) – Expert Level
    Performs HTML coding, 508 compliance, graphics, and content updates, web crawls, and analytics reports…: Designs and builds web pages using a variety of graphics software applications, techniques, and tools, including templates using Joomla and WordPress…
  • Giant Oak Logo4.2
    Senior Back- End Engineer
    Easy Apply
    Integration of multiple data sources including web scale crawling. …: 4 - 5 years of back end development experience Experience developing in Python 3 preferred Experience deploying and working with Amazon Web Services Experience with Elasticsearch and Postgres…
  • Convirgence Consulting Logo4
    Expert Software Developer
    West McLean, VA
    $89,070 - $172,033 (Glassdoor est.)
    Technical Skills: Designs and builds web pages using a variety of graphics software applications, techniques…, and tools, including templates using Joomla and WordPress Provides support to develop Web based…
  • Convirgence Consulting Logo4
    Software Developer
    Herndon, VA
    $73,622 - $140,575 (Glassdoor est.)
    As a Systems Developer supporting the customer, you will be trusted to design and build web pages using a variety of graphics software applications, techniques and tools…Experience designing and building web pages using a variety of graphics software applications…
  • Biourja Power LLC Logo4.6
    Python Developer
    Houston, TX
    $61,709 - $120,879 (Glassdoor est.)
    Easy Apply
    Experience on web crawling, scraping… (Scrapy,BeautifulSoup, Selenium) and web application development using Django/Flask Framework. ? …
  • SKAEL Logo5
    Staff Data Scientist (Team Lead) - NLP + Text Extraction + Document Classification
    San Francisco, CA
    $104,660 - $229,784 (Glassdoor est.)
    Easy Apply
    does not count) Experience with key-value pair extraction Experience with web crawling methodologies. …
  • GoodRx Logo4.6
    Senior Front-End Engineer
    Experience with SEO: page speed, Web Vitals, crawl knowledge Experience with AWS technologies including AppSync, Lambda, StepFunctions, EventBridge… of our services Collaborate, learn, and grow Skills & Qualifications: 5+ years of software development experience, delivering products at web scale Experience with React, TypeScript…
  • Slickdeals Logo4
    SEO Specialist
    Los Angeles, CA
    $45,207 - $95,657 (Glassdoor est.)
    Easy Apply
    In-house Competitive Analysis Tool, web crawling, and auditing. …Able to work with Python, Google Search Console, web crawlers. 1-2 years of experience. …
  • GoodRx Logo4.6
    Technical Lead
    Experience with SEO: page speed, Web Vitals, crawl knowledge Experience with AWS technologies including AppSync, Lambda, StepFunctions… or Senior Engineer 7+ years of software development experience, delivering products at web scale Experience with React, TypeScript, React Context, NodeJS, ES6…
  • Partnerize Logo3.9
    Senior Front-end Software Engineer
    Philadelphia, PA
    $95,597 - $174,634 (Glassdoor est.)
    Easy Apply
    The things you care about: We do large-scale directed web crawling, analysis and storage, and presentation…We crawl relevant pages without crawling the entire web, which involves interpreting signals to determine whether following a link will lead to something interesting, along with the usual spectrum…
  • PriceSpider Logo4.4
    Technical Lead
    Los Angeles, CA
    $85,699 - $170,550 (Glassdoor est.)
    Easy Apply
    Our clients use PriceSpider's proprietary technology to crawl the web and power their tools to reveal the secrets of exactly what people buy…: 6-10 years of relevant industry experience, with 3 or more years of technical leadership in an agile environment and people management experience Demonstratable experience with web crawling, scraping…
  • Kharon Logo3.7
    Data Scientist
    Los Angeles, CA
    $62,822 - $132,298 (Glassdoor est.)
    , evaluating, and optimizing machine learning models Familiarity with NLP Familiarity with web crawling and scraping Familiarity with data wrangling, cleaning, and transformations Experience…
  • SVD Solutions Logo
    Computer Scientist - TS Cleared
    Washington, DC
    $63,834 - $134,246 (Glassdoor est.)
    Computer Networking as well as Tor and Dark Web and Website Crawling required Dockerized applications and Docker orchestration using Kubernetes as well as software engineering & code management best…/commitments take priority) Taking pride in work products and authorship Completing work to quality standards set forth by SVD Solutions and our Clients Abbreviated Job Duties Schedule web crawls Writing Java modules to collect…
  • Go Fish Digital Logo4.6
    SEO Associate
    Raleigh, NC
    $27,997 - $52,436 (Glassdoor est.)
    Easy Apply
    Google Analytics, web crawl results, and rank data are a big part of this job, and you'll be happy analyzing them and clearly communicating valuable insights to your clients…
  • Numerator Logo4.2
    DevOps Engineer
    Chicago, IL
    $66,687 - $126,231 (Glassdoor est.)
    Our technology harnesses consumer-related data in many ways including gamified mobile apps, sophisticated web crawling and enhanced Deep Learning algorithms to deliver an unmatched view…


Job TitleEmployerLocationSalary
Sr .NET Software EngineerPayer CompassPlano, TX
Data EngineerAunalyticsSouth Bend, IN
SENIOR SOFTWARE ENGINEER - Web Crawling (Austin/Remote)DatafinitiAustin, TX
Associate Software EngineerMorningstarWoburn, MA
Data EngineerUnited Solutions LLCRockville, MD
Software Engineer, Full-StackDiffbotMenlo Park, CA
Full Stack DeveloperFinicitySalt Lake City, UT
Software Development Engineer Performance BenchmarkingAmazon Dev Center U.S., Inc.Seattle, WA
Full Stack EngineerThe ShelfBrooklyn, NY
Customer Success & Solutions Engineer (Austin/Remote)DatafinitiAustin, TX
Software Engineer, Webex GraphCisco SystemsSan Jose, CA
Technical SEO Specialist4 Corner ResourcesMadison, WI
Software Development Services LLCManhattan Beach, CA
Python Developer - Houston, TXBioUrja Power, LLCHouston, TX
Principal Text Search Engineer-SOLR/ LucidworksFidelity InvestmentsBoston, MA
Software Developer (Systems Software) – Expert LevelCENCORE LLCVirginia
Senior Back- End EngineerGiant OakVirginia
Expert Software DeveloperConvirgence ConsultingWest McLean, VA
Software DeveloperConvirgence ConsultingHerndon, VA
Python DeveloperBiourja Power LLCHouston, TX
Staff Data Scientist (Team Lead) - NLP + Text Extraction + Document ClassificationSKAELSan Francisco, CA
Senior Front-End EngineerGoodRxCalifornia
SEO SpecialistSlickdealsLos Angeles, CA
Technical LeadGoodRxCalifornia
Senior Front-end Software EngineerPartnerizePhiladelphia, PA
Technical LeadPriceSpiderLos Angeles, CA
Data ScientistKharonLos Angeles, CA
Computer Scientist - TS ClearedSVD SolutionsWashington, DC
SEO AssociateGo Fish DigitalRaleigh, NC
DevOps EngineerNumeratorChicago, IL
Page 1 of 3
  • 1
  • 2
  • 3
🤝What companies are hiring for web crawling jobs?
Your job alert has been created.
Create more job alerts for related jobs with one click: