Job Description
Job Description
Role : Java Developer with Web Crawler Experience
Location : Austin TX(Hybrid)
Responsibilities :
1.Web Crawler Development : Design and implement efficient and scalable web crawlers in Java to collect data from various online sources.
2.Data Extraction : Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.).
3.Data Storage and Processing : Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible.
4.Performance Optimization : Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites.
5.Error Handling and Logging : Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations.
6.Data Integrity and Compliance : Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.
g., robots.txt, copyright laws).
Requirements :
Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient).
Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer.
Strong understanding of HTML, CSS, JavaScript, and web data structures.
Familiarity with data parsing and handling techniques for JSON, XML, and other common formats.
Experience with database technologies (SQL, NoSQL) to store and manage scraped data.
Knowledge of HTTP protocols, headers, proxies, and load handling.
Java Developer with Web Crawler Experience
Role: Java Developer with Web Crawler Experience. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. Proficiency in Java and experience with Java-based web scraping libraries (e. Performance Optimization: Optimize we...
Java Developer with Web Crawler Experience
Role: Java Developer with Web Crawler Experience. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. Proficiency in Java and experience with Javabased web sing libraries (e. Performance Optimization: Optimize web cra...
Java Developer with Web Crawler Experience
Role: Java Developer with Web Crawler Experience. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. Proficiency in Java and experience with Java-based web scraping libraries (e. Performance Optimization: Optimize we...
Java Developer with Web Crawler Experience
Role: Java Developer with Web Crawler Experience. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. Proficiency in Java and experience with Javabased web sing libraries (e. Performance Optimization: Optimize web cra...
Java Database Developer/Programmer Analyst (Required cand with Public Sector/Health Care exp)
Java development, including extensive experience with J2EE, Servlet and related technologies. Experience in Full Stack Development and working with front-end technologies such as JavaScript and JSF and Prime Faces 7. Strong experience in building and consuming Web Services (SOAP/REST). Program will ...
Senior Java Developer with Java 8
Lead Java Backend engineer with good hands-on experience (8 to 10+ years) in Java. Senior Java Backend engineer with good hands-on experience in Java, multi-threading, no-sql/SQL, Kafka, Shell Scripting, REST API, building distributed components. Core Java knowledge is a must (Java 8+). Experience i...
Spark Developer with Java
At least 4 years of Information Technology experienceAt least 3 years of experience in Spark, Hadoop Engineering (Hive, HDFS), At least 2 years of experience in Java. Job description Infosys is seeking a Spark Developer with Java. You will be responsible to collaborate with key partners and apply yo...
QA Automation with Java Experience (Selenium)
QA Automation with Java Experience (Selenium). Proficiency with most of the following technologies: Test Automation, Selenium, Sauce Labs, Java, Test NG, Cucumber, Strong SQL. Hands-on experience with tools maven, Jenkins, RestAssured, postman, TesNg, Git, etc. Strong written and verbal communicatio...
Java Full stack Developer with Angular or React
Desired skills and experiences• Experience in software application development using Java, Spring MVC, Spring Boot, Microservices • Hands on experience in front-end technologies such as JavaScript, AngularJS or React JS• Experience in creating and using RESTful web services using Java and Spring Boo...
React UI Sr. Developer with Java Development Exp.
Location : Plano-TX - Onsite and Hybrid (locals only)<br /> Job type : Contract<br /> Exp : 10+<br /> <br /> Job description :<br /> <br /> Required skills:<br /> <br /> 9+ years of experience in UI development with React<br /> Proficienc...