OpenSearch Project Blog

In search engines and machine learning, data normalization is essential for making fair and accurate comparisons between different features or scores. Hybrid queries use multiple normalization techniques to prepare final results. The two...

Authors Varun Jain Varun Jain is a Software Development Engineer working on the OpenSearch Project and Amazon OpenSearch Service. He primarily works on distributed systems and is an active contributor...

OpenSearch Query Insights gives you essential visibility into how search queries perform, helping you understand how queries run and how they use cluster resources. Since introducing Query Insights, we’ve aimed...

OpenSearch provides a wide range of capabilities to support modern search needs, including traditional keyword-based techniques like lexical search using BM25 and more advanced methods like semantic and hybrid search....

Vector search plays a crucial role in many machine learning (ML) and data science pipelines. In the context of large language models (LLMs), vector search powers retrieval-augmented generation (RAG), a technique...

Introduced in OpenSearch 2.18, Intel Advanced Vector Extensions 512 (Intel AVX-512) is a set of new instructions that can accelerate vector workload performance. Vector search benchmarks using OpenSearch Benchmark showed...

OpenSearch is a scalable open-source search and analytics platform that can serve as the core of a Security Information and Event Management (SIEM) system. OpenSearch can centralize logs from diverse...

OpenSearch’s adoption as a vector database has grown significantly with the rise of generative AI applications. Vector search workloads are scaling from millions to billions of vectors, making traditional CPU-based indexing both...

As organizations increasingly rely on cloud services, monitoring and detecting anomalies in system behavior has become crucial for maintaining reliable operations. In this post, we’ll explore recent improvements to the...

OpenSearch is a powerful open-source search and analytics engine that enables you to efficiently search and filter large datasets. A common search pattern involves filtering documents based on whether a...

Vector search has gained significant attention in the area of information retrieval thanks to advances in natural language embedding models. These models map domain-specific data into a vector space, where...

OpenSearch 2.19 introduces reciprocal rank fusion (RRF), a new feature in the Neural Search plugin that enhances hybrid search. RRF merges ranked results from multiple query sources, such as neural...

The OpenSearch Anomaly Detection plugin is powered by the Random Cut Forest (RCF) algorithm. Although RCF is a powerful algorithm, false alarms reduce its practical value because users must spend time verifying...

In an earlier blog post, we introduced OpenSearch’s support for the DeepSeek large language model (LLM). This post focuses on simplifying DeepSeek LLM integration using the OpenSearch Flow Framework plugin. With...

OpenSearch now integrates with DeepSeek, offering powerful and cost-effective AI capabilities. In this blog post, we’ll guide you through setting up a retrieval-augmented generation (RAG) system using OpenSearch and the DeepSeek...

We’re excited to announce that OpenSearch now supports DeepSeek integration, providing powerful and cost-effective AI capabilities. DeepSeek-R1 is a recently released open-source large language model (LLM) that delivers similar benchmarking performance to...

Upgrading to OpenSearch offers many advantages, but it can also introduce unexpected challenges. One such issue we’ve encountered while assisting with upgrades from older Elasticsearch versions is the “cold start...

Introduction Hybrid search combines lexical and neural search to improve search relevance; this combination shows promising results across industries and in benchmarks. In OpenSearch 2.18, hybrid search is an arithmetic combination of the...

Developing OpenSearch Dashboards (OSD) can feel overwhelming, whether you’re setting up your environment for the first time or starting work on a significant feature. This blog post introduces developer tools...

OpenSearch supports a wide variety of use cases—such as logs, metrics, traces, website search, and vectors—and enables you to build solutions for various applications based on your use case. As the use cases for OpenSearch...