Blog

What in the ML is going on around here?

Nov 02, 2023 • technical

Going from a vanilla install of OpenSearch to having vectorized text stored in a k-NN–enabled index seemed like a quick learning exercise. On paper, it almost looked easy. Upload a...

Introducing a traffic capture and replay solution for OpenSearch migrations and upgrades

Oct 26, 2023 • technical-post

We are thrilled to introduce the beta release of a live traffic capture and replay solution designed to assist users in migrating to OpenSearch. This tool equips users to capture...

Efficient filtering in OpenSearch vector engine

Oct 18, 2023 • technical-posts

With the release of OpenSearch 2.9, we introduced efficient filtering, or “filter-while-search,” functionality for queries using the Facebook AI Similarity Search (Faiss) engine. This update overcomes the previous limitations of...

Introducing concurrent segment search in OpenSearch

Oct 18, 2023 • search, technical-post

OpenSearch is a scalable, flexible, and extensible open-source search and analytics engine. It is built on top of Apache Lucene and uses its powerful capabilities to ingest user data and...

Get started with OpenSearch 2.11

Oct 16, 2023 • releases

OpenSearch 2.11 is now available, with exciting new capabilities for observability applications, an expanded selection of search tools, enhancements to data durability, and more, along with new experimental functionality to...

Announcing Data Prepper 2.5.0

Oct 11, 2023 • releases

Data Prepper 2.5.0 is now available for download. This release includes a new OpenSearch source, new dissect and translate processors, and additions to the existing key-value processor.

Byte-quantized vectors in OpenSearch

Oct 09, 2023 • technical-posts

In OpenSearch k-NN plugin when we index and query vectors of type float, each vector element occupies 4 bytes. This is getting expensive in terms of memory and storage, especially...

Growth and community take the spotlight at OpenSearchCon 2023

Oct 06, 2023 • community

More than 300 attendees—an increase of 60% year-over-year—arrived at the Sheraton Grand Seattle for 3 days of connecting, sharing, and learning with the OpenSearch community. We renewed old friendships and...

New IP2Geo processor with automatic update in OpenSearch

Oct 04, 2023 • technical-posts

When you host a service across geographic regions, it often helps to understand load patterns from various geographies. In many cases it helps to analyze anomalies and attacks. Starting with...

Improve search relevance with hybrid search, generally available in OpenSearch 2.10

Oct 04, 2023 • technical-posts

In an earlier blog post, a group of Amazon scientists and engineers described methods of combining keyword-based search with dense vector search in order to improve search relevance. With OpenSearch...

Improved durability in OpenSearch with remote-backed storage

Sep 27, 2023 • community

We are excited to announce remote-backed storage, a new feature that enables request-level durability with remote storage options like Amazon Simple Storage Service (Amazon S3), Oracle Cloud Infrastructure Object Storage,...

Exploring OpenSearch 2.10

Sep 25, 2023 • releases

OpenSearch 2.10 is ready to download, with new tools for search, security, and machine learning applications, improved storage durability options, a better way to analyze and visualize your data in...

OpenSearch search personas: Creating Figma templates to represent a persona framework

Sep 22, 2023 • community

There is a popular perception that open-source projects are poorly designed. The challenges that open-source software designers face include more than just GitHub requiring coding skills.Although open-source software is a...

OpenSearch Security: A Testament to Our Commitment

Sep 18, 2023 • technical-post

In OpenSearch, there’s an understanding that security isn’t just a feature, but a foundational part of our software. Today, we’re excited to discuss the findings of a recent in-depth independent...

Use OpenSearch Benchmark with Randomized Query Terms

Sep 14, 2023 • technical-post

Performance testing is part science and part art. On the measurement side, you employ science to run test cases, collect and visualize metrics, and evaluate results. On the test creation...