Web crawler in Java

Web crawler in Java :

Definition :

A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion.

For more information visit the wiki page for Web_crawler

Sample Java Program :

package com.test.main;

import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.net.URL;

public class WebCrawler {

* @param args
public static void main(String[] args) {
// TODO Auto-generated method stub
try {
URL url = new URL(“http://blog.iguddy.com/”);
BufferedReader br = new BufferedReader(new InputStreamReader(url.openStream()));
String temp = “”;
while(null != (temp = br.readLine())){
} catch (Exception ex) {






Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s