
Explore Vespa, an open-source platform for large-scale, low-latency data serving. Store and index structured, text, and vector data for fast querying, including vector and lexical search in one query.
Explore Vespa's real-time data processing for up-to-date search and recommendations, and leverage its flexible query language, machine learning integration, and scalable, high-availability architecture with multi-tenancy.
Discover Vespa architecture and how application packages, admin/config cluster, and stateless Java container cluster enable real-time processing, scalable search, and distributed query execution.
A tenant serves as a unique identifier and isolated space in Vespa cloud for your account or organization, organizing and securing configurations, data, and applications.
Discover the whisper cloud console overview, managing tenants and apps, accounts, billing plans, notifications, tokens, keys, secret store, and support within a trial environment.
Load and inspect the NF corpus from the hugging face dataset library; compare streaming and non-streaming, and note arrow data set and data set iterable types.
Create a Vespa cloud instance using interactive authentication by following the authentication link, confirming the device, and verifying a successful login, with certificates stored in Google Cloud files.
Create a vespa cloud instance using a pem file for automatic authentication. Upload and read the pem content, compare interactive authentication for development with key-based authentication for production.
Deploy a Vespa application to the Westpac cloud with a single line command, view deployment status, and retrieve the endpoint URL.
Feed documents to a Vespa application using Vespa format and feed iterable to index documents, with a callback monitoring success or errors and configuring the schema and namespace (tutorial).
Use the display hits function to turn spark query results into a pandas data frame for easy analysis and visualization of Vespa AI search results.
Explore plain keyword search in Vespa by indexing titles and bodies with BM25, ranking with tf-idf, and retrieving the top five results with YQL.
Explore Vespa hybrid search that fuses keyword search and semantic search with the or operator to retrieve documents matching either method, using reciprocal rank fusion and vector embeddings.
Explore hybrid search with the rank query operator that blends keyword search (BM25) and semantic search via vector embeddings with a reciprocal rank fusion ranking function.
Explore hybrid search with filters that combine keyword and semantic relevance to narrow results by date or document type. See queries converted to embeddings and ranked in a vector space.
Connect to a spark instance via the request library, retrieve a Vespa document, update its title, and verify the changes to maintain data integrity.
Reconnect the Vespa application by providing the certificate path, key path, and endpoint, uploading PEM files, and deploying to run a plain keyword search for verification.
This course is a comprehensive guide to building advanced search engines and vector databases using Vespa AI and Python. It is designed for data scientists, software developers, AI enthusiasts, and anyone interested in mastering modern search technologies. Throughout this course, you will learn the fundamentals of Vespa AI, including its architecture and core components, and how to leverage its capabilities to build high-performance search applications.
You will gain hands-on experience with Python to integrate Vespa AI for real-time data processing, ranking, and retrieval. The course covers essential topics such as developing and deploying vector databases, creating scalable search engines, and using machine learning models to enhance search results. Additionally, you will explore advanced search techniques like semantic search, approximate nearest neighbor search, and hybrid search methods.
The course includes practical projects that guide you through deploying applications on Vespa Cloud, optimizing search performance with custom ranking functions, and implementing filters and cross-hit normalization for better search accuracy. By the end of this course, you will have the skills to create and deploy powerful, scalable search applications and vector databases.
Prerequisites include a basic understanding of Python and familiarity with Google Colab. This course provides valuable insights and practical experience to advance your knowledge in search technologies and AI integration.
Source code is provided in sections.