scroll to top
Stuck on your essay?
Get ideas from this essay and see how your work stacks up
Word Count: 1,802
Contents CONTENTS 2 PROLOGUE 3 WEB-SPIDERS TASK DESCRIPTION 4 PREPARATION 5 JAVA 5 WHAT COULD GO WRONG 7 CONCLUDE 9 USED MATERIALS 10 Prologue Hyperlinks allow for the navigation in the internet Web pages can be linked with other pages one important question is with which other pages a page is linked The resulting link structure can be visualized using a directed graph The nodes of the graph denote the individual web page whereas arrows connecting the nodes represent hyperlinks referring from one page to another In order to develop such a application its needed to go through all Html-code which given link consists and look for ltAgt tags with lthrefgt argument and cut each of them out This step is most important next steps are just for manipulating with those url-s As we need not just one page url-s but all url-s which are connected to given page we have to go them through once again And finally merge together gathered links and application which makes graph from them This is very rough explanation what should be done order to make web-spider Next chapters are devoted for step by step instructions how to make web-spider and what kind of problems may appear doing it Web-Spiders task description Develop a web spider that is an application that takes the URL of a web page as input and extracts all hyperlinks of this page For each web page that can be reached by these hyperlinks again all hyperlinks are to be extracted The result should be visualized as a directed graph For the visualization you can use the Graphviz tool which takes a graph description in the dot format as an input and draws the graph as a SVG image The following picture shows the HTML code of the site wwwmailde and the resulting graph
@Kibin is a lifesaver for my essay right now!!
- Sandra Slivka, student @ UC Berkeley
Wow, this is the best essay help I've ever received!
- Camvu Pham, student @ U of M
If I'd known about @Kibin in college, I would have gotten much more sleep
- Jen Soust, alumni @ UCLA