There was a new study which showed how sophisticated search engines are only able to scratch at the surface of the web's information reservoir because of how big the Internet has become. There was a 41 page research paper prepared by a South Dakota company responsible for developing a new Internet software that mentioned how the Web is actually 500 times larger than what search engines like Yahoo, AltaVista, and Google are presenting.
The reason why much frustration is being caused by these hidden information coves is because they hinder people from getting what they need online. With regard to search engines nowadays, there are a lot of people complaining about them in the same way as they do with weather. Referring to the uncharted territory of the Internet's World Wide Web sector for so long is what we all know as the invisible Web.
Distinguishing the terrain from what is considered to be the surface information captured by the Internet search engines, there is one Sioux Falls start up company that describes it as the deep Web. As compared with the past the invisible Web is now gone.
Taking into consideration what they are engaged in, according to the general manager of the company this is the coolest part of it all. What the researchers said was that these underutilized outposts of cyberspace represented a substantial chunk of the Internet but this new company was the only one that explored the Web's back roads extensively.
Deployed in the past six months is a new software that is able to determine that 550 billion documents are stored on the Web. Combined, Internet search engines index about 1 billion pages.
About 54,000 pages was indexed by one of the first Web engines, lycos, in mid 1994. While search engines obviously have come a long way since 1994, they aren't indexing even more pages because an increasing amount of information is stored in evolving, giant databases set up by government agencies, universities and corporations.
Instead of going for the dynamic information stored in databases, what search engines rely on is the technology that identifies static pages. More queries are necessary if you wish to find out what is in a site because search engines will only bring you to a home site that houses a huge database.
The company believes it has developed a solution with software called lexibot. Everything starts off with a single search request and then it searches the various pages indexed by traditional search engines and then goes into Internet databases for information.
The software isn't for everyone, though, executives concede. You get a 30 day free trial for this software and then it would cost $89.
The case with the lexibot is that it is not any faster than usual. Expect to spend about 90 minutes for complex searches while typical searches will take 10 to 25 minutes to complete on the average.
Considering this, grandma should not even expect to make use of it to locate chocolate chip cookie or carrot cake recipes through the Internet. It is according to the privately held company that lexibot should be utilized in the academic and scientific circles. What the Internet veterans said was that the company's research was intriguing but it is possible for the software to become overwhelming.
Considering the heightened size of the World Wide Web, specialized search engines could be the key. Utilizing a centralized approach in this case will not result to making it more successful. When it comes to the greatest challenge for the company, it is in telling businesses and people about what they have discovered.
![[Valid RSS feed]](http://www.articlemarketinghome.com/images/icon_Rss.png "XML Feed For RSS"){kind=icon}
Category Rss Feed
Print This Article
Add To Favorites