Building a Search Engine
- 3.5 hours on-demand video
- 1 article
- 3 downloadable resources
- Full lifetime access
- Access on mobile and TV
- Certificate of Completion
Get your team access to 4,000+ top Udemy courses anytime, anywhere.Try Udemy for Business
- Cover all algorithms used in Search Engines
- Introduce you to Big Data technologies and explain how to use them to build a Search Engine
- Couse contents are updated regularly.
- Reveles all secret spam fighting techniques used by GOOGLE
This lecture gives you an overview of the course. This lecture will tell you the things you are going to learn and also importance of this lecture in your life.
Things you will learn:
1. Search Engine architecture (crawler, indexer, query processor and parser).
2. Web crawler algorithms and efficiency.
3. Spider traps.
4. Web scraping
5. Spam fighting.
6. Replication and sharding
7. HTTP attacks
8. Query understanding
9. Spell checking algorithm and using apache solr.
10. Auto complete
11. Big data
Introduces you to Search Engine. Talks about difference between search engine and web search engine. Gives you an overview of World Wide Web. Provides definition and explanation to these topics briefly.
This lecture gives you a difference between metasearch engine and a web search engine. DuckDuckGo is a metasearch engine but google is a search engine. Its easy to create a metasearch engine. Metasearch engine requires less resources and can be rapidly created and deployed successfully.
This lectures explains one of the most important feature integrated into most of the search engines called as social search. This features helps you find more organic results. And makes the search more meaningful. Integrating social search requires and a lot of users using your search engine and must have put up their personal information into your search engine. Social feature can also be enabled using ip tracking and understanding user queries. Social search is a application of machine learning.
Instead of trying to build a search engine from scratch its a good choice to use a open source search engine. It will save time and you will have your search engine build up quickly. There are a large number of open source search engine. Most of them are well documentated.
This lectures gives you a overview of common architectures used in modern search engines.
Components of a search engine:
4. Query Processor
Bad design of any one component will lead to a bad search engine. Every component needs to be designed carefully and tested for every situation before deploying.
Spider traps are different techniques by which a web crawler can be put into an problem. A good web crawler should prevent all kinds of spider traps. Everyday hackers find new spider traps techniques and you should be intelligent enough to catch them and rectify your crawler code to escape from the traps.
Index is a data structure into which documents can put into quickly and also retrieved quickly. Index data structure is used in almost all types of application. A pdf reader indexer the whole document and finds the page number when your search for a word in the document. Similarly a search engine also indexes.
- OS X, Windows or Ubuntu
With "Developing a Search Engine", you will learn everything about Search Engines, even if you've never build one before!
The full course has several video lectures, divided into several chapters. Each chapter will give you a new level of knowledge in Search Engine development. We'll start from the basics of Search Engine development to more advanced and the most popular algorithms used now a days.
"Building a Search Engine" will give you a new perspective on how the Internet works and after you completed the course you will be able to create your own Search Engine with the latest technology and algorithms. Hope you enjoy!
NOTE: In order to keep you up to date in the world of Search Engine Development all the chapters will be updated regularly with new lectures, projects, quizzes and any changes in future versions of all the programming languages covered on the course.
Why Learn Search Engine Development?
The internet is the fastest and largest platform ever created for humans to learn, communicate, share, or create businesses of any kind, and all of this in just 15 years! It is estimated that in the next 2 or 3 years more than 80%%%% of the companies around the world will become internet dependent which will cause a huge demand for Search Engine developer in this market. As the World Wide Web grows Search Engines needs to upgraded proportionally.
Learning Search Engine Development will give you the opportunity to start ahead of other competitors by giving you the knowledge of the most recent web technologies and how to better apply them on your future projects. Knowing Search Engine Development will give you the ability to control and create anything on the web.
How this course will help you to get a Job?
At present the fastest growing technology in the Internet is Search Engines. Google makes thousands of changes every year and employees larger number of engineers who can make their Search Engine more efficient as the structure of the web is becoming larger and complicated. Other companies are employing Search Engine experts to optimize their websites to appear on top results in Search Engines.
I promise you would have never had such kind of learning experience.
Welcome to "Building a Search Engine"
- Needs to know basics of Networking
- Needs to know basics of Web Development
- Should be familier with atleast one programming language