fsspec_data.backends.http

Classes

HTTPFilesystem

Docs: https://filesystem-spec.readthedocs.io/en/latest/developer.html#implementing-a-backend

Module Contents

class fsspec_data.backends.http.HTTPFilesystem(*args, **storage_options)[source]

Bases: fsspec_data.backends.base.BaseFileSystem

Docs: https://filesystem-spec.readthedocs.io/en/latest/developer.html#implementing-a-backend Minimal: https://github.com/fsspec/filesystem_spec/blob/45dcfa99e2dc320bf072c28bef767b71f8299a4a/fsspec/implementations/github.py#L10

Create and configure file-system instance

Instances may be cachable, so if similar enough arguments are seen a new instance is not required. The token attribute exists to allow implementations to cache instances if they wish.

A reasonable default should be provided if there are no arguments.

Subclasses should call this method.

Parameters:

  • use_listings_cache – passed to DirCache, if the implementation supports directory listing caching. Pass use_listings_cache=False to disable such caching.

  • listings_expiry_time – passed to DirCache, if the implementation supports directory listing caching. Pass use_listings_cache=False to disable such caching.

  • max_paths – passed to DirCache, if the implementation supports directory listing caching. Pass use_listings_cache=False to disable such caching.

  • skip_instance_cache (bool) – If this is a cachable implementation, pass True here to force creating a new instance even if a matching instance exists, and prevent storing this instance.

  • asynchronous (bool)

  • loop (asyncio-compatible IOLoop or None)