langchain.document_loaders.s3_directory.S3DirectoryLoader

class langchain.document_loaders.s3_directory.S3DirectoryLoader(bucket: str, prefix: str = '')[source]

Bases: BaseLoader

Loading logic for loading documents from an AWS S3.

Initialize with bucket and key name.

Parameters

  • bucket – The name of the S3 bucket.

  • prefix – The prefix of the S3 key. Defaults to “”.

Methods

__init__(bucket[, prefix])

Initialize with bucket and key name.

lazy_load()

A lazy loader for Documents.

load()

Load documents.

load_and_split([text_splitter])

Load Documents and split into chunks.
lazy_load() → Iterator[Document]

A lazy loader for Documents.

load() → List[Document][source]

Load documents.

load_and_split(text_splitter: Optional[TextSplitter] = None) → List[Document]

Load Documents and split into chunks. Chunks are returned as Documents.

Parameters

text_splitter – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.

Returns

List of Documents.

Examples using S3DirectoryLoader