Python internal API

gafaelfawr Package

The Gafaelfawr service.

Variables

__version__

The application version string (PEP 440 / SemVer compatible).

gafaelfawr.auth Module

Utility functions for manipulating authentication headers.

Functions

clean_authorization(headers)	Remove Gafaelfawr tokens from Authorization headers.
clean_cookies(headers)	Remove Gafaelfawr cookies from cookie headers.
generate_challenge(context, auth_type, exc)	Convert an exception into an HTTP error with WWW-Authenticate.
generate_unauthorized_challenge(context, ...)	Construct exception for a 401 response with AJAX handling.
parse_authorization(context)	Find a handle or token in the Authorization header.

gafaelfawr.cache Module

Shared caches.

These caches are process-global, managed by ProcessContext. The common theme is some storage wrapped in an asyncio.Lock, possibly with some complex structure to allow per-user locking. These services sit below the main service layer and are only intended for use via their service layer (TokenCacheService, LDAPService, and FirestoreService).

Classes

BaseCache()	Base class for caches managed by a cache dependency.
IdCache()	A cache of UIDs or GIDs.
InternalTokenCache()	Cache for internal tokens.
PerUserCache()	Base class for a cache with per-user locking.
LDAPCache(content)	A cache of LDAP data.
NotebookTokenCache()	Cache for notebook tokens.
TokenCache()	Base class for a cache of internal or notebook tokens.
UserLockManager(general_lock, user_lock)	Helper class for managing per-user locks.

Class Inheritance Diagram

gafaelfawr.config Module

Configuration for Gafaelfawr.

There are two, mostly-parallel models defined here. The ones ending in Settings are the pydantic models used to read the configuration file from disk, the root of which is Settings. This is then processed and broken up into configuration dataclasses for various components and then exposed to the rest of Gafaelfawr as the Config object.

Classes

Config(realm, loglevel, session_secret, ...)	Configuration for Gafaelfawr.
FirestoreConfig(project)	Configuration for Firestore-based UID/GID assignment.
FirestoreSettings(**data)	pydantic model of Firestore configuration.
GitHubConfig(client_id, client_secret)	Metadata for GitHub authentication.
GitHubSettings(**data)	pydantic model of GitHub configuration.
LDAPConfig(url, user_dn, password, group_base_dn)	Configuration for LDAP support.
LDAPSettings(**data)	pydantic model of LDAP configuration.
NotebookQuota(cpu, memory)	Quota settings for the Notebook Aspect.
OIDCConfig(client_id, client_secret, ...)	Configuration for OpenID Connect authentication.
OIDCClient(client_id, client_secret)	Configuration for a single OpenID Connect client of our server.
OIDCServerConfig(issuer, key_id, audience, ...)	Configuration for the OpenID Connect server.
OIDCServerSettings(**data)	pydantic model of issuer configuration.
OIDCSettings(**data)	pydantic model of OpenID Connect configuration.
Quota(default, groups)	Quota settings.
QuotaGrant(api, notebook)	One grant of quotas.
Settings(**data)	pydantic model of Gafaelfawr configuration file.

Class Inheritance Diagram

gafaelfawr.constants Module

Constants for Gafaelfawr.

Variables

ACTOR_REGEX	Regex matching all valid actors (including <bootstrap>).
ALGORITHM	JWT algorithm to use for all tokens.
BOT_USERNAME_REGEX	Regex matching a valid username that is also a bot user.
CHANGE_HISTORY_RETENTION	Retention of old token change history entries.
CONFIG_PATH	Default configuration path.
COOKIE_NAME	Name of the state cookie.
CURSOR_REGEX	Regex matching a valid cursor.
GID_MIN	Minimum GID for groups.
GID_MAX	Maximum gid for groups.
GROUPNAME_REGEX	Regex matching all valid group names.
HTTP_TIMEOUT	Timeout (in seconds) for outbound HTTP requests to auth providers.
ID_CACHE_SIZE	How many UID or GID values to cache in memory.
KUBERNETES_TIMER_DELAY	How long (in seconds) to delay timers after startup and changes.
KUBERNETES_TOKEN_INTERVAL	How frequently (in seconds) to validate service tokens stored in secrets.
LDAP_CACHE_SIZE	Maximum numbr of entries in LDAP caches.
LDAP_CACHE_LIFETIME	Lifetime of the LDAP caches in seconds.
LDAP_TIMEOUT	Timeout (in seconds) for LDAP queries.
MINIMUM_LIFETIME	Minimum expiration lifetime for a token.
NGINX_SNIPPET	Code snippet to put into NGINX configuration for each ingress.
OIDC_AUTHORIZATION_LIFETIME	How long (in seconds) an authorization code is good for.
SCOPE_REGEX	Regex matching a valid scope.
TOKEN_CACHE_SIZE	How many internal or notebook tokens to cache in memory.
UID_BOT_MIN	Minimum UID for bot users.
UID_BOT_MAX	Maximum UID for bot users.
UID_USER_MIN	Minimum UID for users.
USERNAME_REGEX	Regex matching all valid usernames.

gafaelfawr.dependencies.auth Module

Authentication dependencies for FastAPI.

Functions

verified_oidc_token([context])

Require that a request be authenticated with an OpenID Connect token.

Classes

Authenticate([require_session, ...])	Dependency to verify user authentication.
AuthenticateRead([require_session, ...])	Authenticate a read API.
AuthenticateWrite([require_session, ...])	Authenticate a write API.

Class Inheritance Diagram

gafaelfawr.dependencies.config Module

Config dependency for FastAPI.

Classes

ConfigDependency()

Provides the configuration as a dependency.

Variables

config_dependency

The dependency that will return the current configuration.

Class Inheritance Diagram

gafaelfawr.dependencies.context Module

Request context dependency for FastAPI.

This dependency gathers a variety of information into a single object for the convenience of writing request handlers. It also provides a place to store a structlog.BoundLogger that can gather additional context during processing, including from dependencies.

Classes

RequestContext(request, ip_address, config, ...)

Holds the incoming request and its surrounding context.

Class Inheritance Diagram

gafaelfawr.dependencies.return_url Module

FastAPI dependencies for checking the return URL.

Several API routes allow the caller to request a redirect back to a return URL given as a parameter. To avoid creating an open redirect, those return URLs must be located at the same hostname as the route being called. Provide several variations of a dependency to check this.

Functions

parsed_redirect_uri([redirect_uri, context])	Validate a return URL in a redirect_uri parameter.
return_url([rd, context])	Validate a return URL in an rd parameter.
return_url_with_header([rd, ...])	Validate a return URL in an rd parameter or header.

gafaelfawr.exceptions Module

Exceptions for Gafaelfawr.

Classes

DeserializeError	A stored object could not be decrypted or deserialized.
DuplicateTokenNameError(message)	The user tried to reuse the name of a token.
FetchKeysError	Cannot retrieve the keys from an issuer.
FirestoreError	An error occurred while reading or updating Firestore data.
FirestoreNotInitializedError	Firestore has not been initialized.
GitHubError	GitHub returned an error from an API call.
InsufficientScopeError	The provided token does not have the right authorization scope.
InvalidClientError	The provided client_id and client_secret could not be validated.
InvalidCSRFError(message)	Invalid or missing CSRF token.
InvalidCursorError(message)	The provided cursor was invalid.
InvalidExpiresError(message)	The provided token expiration time was invalid.
InvalidGrantError	The provided authorization code is not valid.
InvalidIPAddressError(message)	The provided IP address has invalid syntax.
InvalidMinimumLifetimeError(message)	The minimum_lifetime parameter was set to an invalid value.
InvalidRequestError	The provided Authorization header could not be parsed.
InvalidReturnURLError(message, field)	Client specified an unsafe return URL.
InvalidScopesError(message)	The provided token scopes are invalid or not available.
InvalidTokenClaimsError	One of the claims in the token is of an invalid format.
InvalidTokenError	The provided token was invalid.
KubernetesError	An error occurred during Kubernetes secret processing.
KubernetesObjectError(kind, name, namespace, exc)	A Kubernetes object could not be parsed.
LDAPError	Group information for the user in LDAP was invalid.
MissingGIDClaimError	The token is missing the required GID claim.
MissingUIDClaimError	The token is missing the required UID claim.
MissingUsernameClaimError	The token is missing the required username claim.
NoAvailableGidError	The assigned UID space has been exhausted.
NoAvailableUidError	The assigned UID space has been exhausted.
NotConfiguredError	The requested operation was not configured.
OAuthError	An OAuth-related error occurred.
OAuthBearerError	An error that can be returned as a WWW-Authenticate challenge.
OIDCError	The OpenID Connect provider returned an error from an API call.
PermissionDeniedError	The user does not have permission to perform this operation.
ProviderError	An authentication provider returned an error from an API call.
UnauthorizedClientError	The client is not authorized to request an authorization code.
UnknownAlgorithmError	The issuer key was for an unsupported algorithm.
UnknownKeyIdError	The reqeusted key ID was not found for an issuer.
ValidationError(message, location, field)	Represents an input validation error.
VerifyTokenError	Base exception class for failure in verifying a token.

Class Inheritance Diagram

gafaelfawr.factory Module

Create Gafaelfawr components.

Classes

Factory(context, session, logger)	Build Gafaelfawr components.
ProcessContext(config, http_client, ...)	Per-process application context.

Class Inheritance Diagram

gafaelfawr.keypair Module

RSA key pair handling.

Classes

RSAKeyPair(private_key)

An RSA key pair with some simple helper functions.

Class Inheritance Diagram

gafaelfawr.middleware.state Module

State cookie management.

Classes

BaseState()	Base class for state information stored in a cookie.
StateMiddleware(app, *, cookie_name, state_class)	Middleware to read and update an encrypted state cookie.

Class Inheritance Diagram

gafaelfawr.models.admin Module

Representation of a token administrator.

Classes

Admin(**data)

A token administrator.

Class Inheritance Diagram

gafaelfawr.models.auth Module

Representation of authentication-related data.

Classes

APIConfig(**data)	Configuration information for the API.
APILoginResponse(**data)	Response to an API login request.
AuthChallenge(auth_type, realm)	Represents a WWW-Authenticate header for a simple challenge.
AuthError(value[, names, module, qualname, ...])	Valid authentication errors for a WWW-Authenticate header.
AuthErrorChallenge(auth_type, realm, error, ...)	Represents a WWW-Authenticate header for an error challenge.
AuthType(value[, names, module, qualname, ...])	Authentication types for the WWW-Authenticate header.
Satisfy(value[, names, module, qualname, ...])	Authorization strategies.
Scope(**data)	A known token scope.

Class Inheritance Diagram

gafaelfawr.models.history Module

Representation of a token or admin history event.

Classes

AdminChange(value[, names, module, ...])	Type of change made to a token admin.
AdminHistoryEntry(**data)	A record of a change to the token administrators.
HistoryCursor(time, id[, previous])	Pagination cursor for history entries.
PaginatedHistory(entries, count[, ...])	Encapsulates paginated history entries with pagination information.
TokenChange(value[, names, module, ...])	Type of change made to a token.
TokenChangeHistoryEntry(**data)	A record of a change to a token.

Class Inheritance Diagram

gafaelfawr.models.kubernetes Module

Models for Kubernetes operators.

Classes

GafaelfawrIngress(**data)	Representation of a GafaelfawrIngress resource.
GafaelfawrIngressConfig(**data)	Configuration settings for an ingress using Gafaelfawr for auth.
GafaelfawrIngressDelegate(**data)	Configuration for delegated tokens requested for a service.
GafaelfawrIngressDelegateInternal(**data)	Configuration for a delegated internal token.
GafaelfawrIngressDelegateNotebook(**data)	Configuration for a delegated notebook token.
GafaelfawrIngressMetadata(**data)	Metadata used to create an Ingress object.
GafaelfawrIngressPath(**data)	A path routing rule for an ingress.
GafaelfawrIngressPathBackend(**data)	Backend that serves a given path.
GafaelfawrIngressPathService(**data)	Service that serves a given path.
GafaelfawrIngressRule(**data)	A routing rule for an ingress.
GafaelfawrIngressRuleHTTP(**data)	Routing rules for HTTP access.
GafaelfawrIngressScopesAll(**data)	Represents scopes where all scopes are required.
GafaelfawrIngressScopesAny(**data)	Represents scopes where any scope is sufficient.
GafaelfawrIngressScopesBase(**data)	Base class for specifying the required scopes.
GafaelfawrIngressSpec(**data)	Template for spec portion of Ingress resource.
GafaelfawrIngressTLS(**data)	A TLS certificate rule for an ingress.
GafaelfawrIngressTemplate(**data)	Template for Ingress created from GafaelfawrIngress resource.
GafaelfawrServicePortName(**data)	Port for a service.
GafaelfawrServicePortNumber(**data)	Port for a service.
GafaelfawrServiceToken(**data)	Representation of a GafaelfawrServiceToken resource.
GafaelfawrServiceTokenSpec(**data)	Holds the spec section of a GafaelfawrServiceToken resource.
KubernetesMetadata(**data)	The metadata section of a Kubernetes resource.
KubernetesResource(**data)	A Kubernetes resource being processed by an operator.
KubernetesResourceStatus(message, ...[, ...])	Represents the processing status of a Kubernetes resource.
PathType(value[, names, module, qualname, ...])	Matching types for paths in ingress rules.
StatusReason(value[, names, module, ...])	Reason for the status update of a GafaelfawrServiceToken.

Class Inheritance Diagram

gafaelfawr.models.ldap Module

Data models for LDAP.

Classes

LDAPUserData([name, email, uid, gid])

Data for a user from LDAP.

Class Inheritance Diagram

gafaelfawr.models.link Module

Representation for a Link HTTP header.

Classes

LinkData(prev_url, next_url, first_url)

Holds the data returned in an RFC 8288 Link header.

Class Inheritance Diagram

gafaelfawr.models.oidc Module

Representation of data for OpenID Connect support.

Classes

JWK(**data)	The schema for a JSON Web Key (RFCs 7517 and 7518).
JWKS(**data)	Schema for the /.well-known/jwks.json endpoint.
OIDCAuthorization(**data)	Represents an authorization for an OpenID Connect client.
OIDCAuthorizationCode(**data)	An OpenID Connect authorization code.
OIDCConfig(**data)	Schema for the /.well-known/openid-configuration endpoint.
OIDCToken(**data)	Holds an encoded JWT.
OIDCVerifiedToken(**data)	Holds a verified JWT.

Class Inheritance Diagram

gafaelfawr.models.state Module

Representation of Gafaelfawr state stored in a cookie.

This is the Gafaelfawr version of ~gafaelfawr.middleware.state.BaseState, used by the ~gafaelfawr.middleware.state.StateMiddleware middleware. It holds the data that Gafaelfawr stores in a session cookie.

Classes

State([csrf, token, github, return_url, state])

State information stored in a cookie.

Class Inheritance Diagram

gafaelfawr.models.token Module

Representation of an authentication token and associated data.

Classes

AdminTokenRequest(**data)	A request to create a new token via the admin interface.
NewToken(**data)	Response to a token creation request.
NotebookQuota(**data)	Notebook Aspect quota information for a user.
Quota(**data)	Quota information for a user.
Token(**data)	An opaque token.
TokenBase(**data)	Base information about a token common to several representations.
TokenData(**data)	Data about a token stored in Redis.
TokenGroup(**data)	Information about a single group.
TokenInfo(**data)	Information about a token returned by the token-info endpoint.
TokenType(value[, names, module, qualname, ...])	The class of token.
TokenUserInfo(**data)	The information about a user stored with their token.
UserTokenRequest(**data)	The parameters of a user token that are under the user's control.
UserTokenModifyRequest(**data)	The parameters of a user token that can be changed.

Class Inheritance Diagram

gafaelfawr.operator Package

Kubernetes operator framework.

This module imports all of the handlers for Gafaelfawr’s Kubernetes operator and serves as an entry point for Kopf.

gafaelfawr.operator.startup Module

Kubernetes operator startup and shutdown.

Functions

startup(memo, **_)	Initialize global data for Kubernetes operators.
shutdown(memo, **_)	Shut down a running Kubernetes operator.

gafaelfawr.operator.tokens Module

Kubernetes operator handlers for GafaelfawrServiceTokens.

Functions

create(name, namespace, body, memo, **_)	Handle creation or modification of a GafaelfawrServiceToken object.
periodic(name, namespace, body, memo, **_)	Periodically re-check all GafaelfawrServiceToken objects.

gafaelfawr.providers.base Module

Base class for authentication providers.

Classes

Provider()

Abstract base class for authentication providers.

Class Inheritance Diagram

gafaelfawr.providers.github Module

GitHub authentication provider.

Classes

GitHubProvider(*, config, http_client, logger)

Authenticate a user with GitHub.

Class Inheritance Diagram

gafaelfawr.providers.oidc Module

OpenID Connect authentication provider.

Classes

OIDCProvider(*, config, verifier, ...)	Authenticate a user with GitHub.
OIDCTokenVerifier(config, http_client, logger)	Verify a JWT issued by an OpenID Connect provider.

Class Inheritance Diagram

gafaelfawr.services.admin Module

Manage the configured token administrators.

Classes

AdminService(admin_store, ...)

Manage the token administrators.

Class Inheritance Diagram

gafaelfawr.services.firestore Module

UID/GID assignment using Firestore.

Classes

FirestoreService(*, uid_cache, gid_cache, ...)

Manage UID and GID assignments using Firestore.

Class Inheritance Diagram

gafaelfawr.services.kubernetes Module

Manage Kubernetes secrets.

Classes

KubernetesIngressService(storage, logger)	Manage Ingress resources with Gafaelfawr annotations.
KubernetesTokenService(*, token_service, ...)	Manage Gafaelfawr service tokens stored in Kubernetes secrets.

Class Inheritance Diagram

gafaelfawr.services.ldap Module

LDAP lookups for user information.

Classes

LDAPService(*, ldap, group_cache, ...)

Perform LDAP lookups for user information.

Class Inheritance Diagram

gafaelfawr.services.oidc Module

OpenID Connect identity provider support.

Classes

OIDCService(*, config, authorization_store, ...)

Minimalist OpenID Connect identity provider.

Class Inheritance Diagram

gafaelfawr.services.token Module

Manage tokens.

Classes

TokenService(*, config, token_cache, ...)

Manage tokens.

Class Inheritance Diagram

gafaelfawr.services.token_cache Module

Cache for internal and notebook tokens.

Classes

TokenCacheService(*, config, internal_cache, ...)

Manage cache internal and notebook tokens.

Class Inheritance Diagram

gafaelfawr.services.userinfo Module

Service and caching layer for user metadata.

Classes

OIDCUserInfoService(*, config, ldap, ...)	Retrieve user metadata from external systems for OIDC authentication.
UserInfoService(*, config, ldap, firestore, ...)	Retrieve user metadata from external systems.

Class Inheritance Diagram

gafaelfawr.slack Module

Send alerts to Slack.

Functions

initialize_slack_alerts(hook_url, ...)

Configure Slack alerting.

Classes

SlackAlertClient(hook_url, application, logger)	Publish alerts to Slack.
SlackIgnoredException	Parent class for exceptions that should not be reported to Slack.
SlackRouteErrorHandler(path, endpoint, *[, ...])	Custom fastapi.routing.APIRoute that reports exceptions to Slack.

Class Inheritance Diagram

gafaelfawr.storage.admin Module

Storage for token administrators.

Classes

AdminStore(session)

Stores and retrieves token administrators.

Class Inheritance Diagram

gafaelfawr.storage.base Module

Base persistant storage classes.

This module provides the lowest-level storage layer of Gafaelfawr for the key/value store. Should Gafaelfawr need to be ported to a storage system other than Redis, the goal is to keep the required changes largely or entirely confined to this file.

Classes

RedisStorage(content, key, redis)

JSON-serialized encrypted storage in Redis.

Class Inheritance Diagram

gafaelfawr.storage.firestore Module

Firestore storage layer for Gafaelfawr.

Classes

FirestoreStorage(config, logger)

Google Firestore storage layer.

Class Inheritance Diagram

gafaelfawr.storage.history Module

Storage for change and authentication history.

Classes

AdminHistoryStore(session)	Stores and retrieves the history of changes to token administrators.
TokenChangeHistoryStore(session)	Stores and retrieves the history of changes to tokens.

Class Inheritance Diagram

gafaelfawr.storage.kubernetes Module

Kubernetes storage layer for Gafaelfawr.

Classes

KubernetesIngressStorage(api_client, logger)	Kubernetes storage layer for ingress objects.
KubernetesTokenStorage(api_client, logger)	Kubernetes storage layer for service token objects.

Class Inheritance Diagram

gafaelfawr.storage.ldap Module

LDAP storage layer for Gafaelfawr.

Classes

LDAPStorage(config, pool, logger)

LDAP storage layer.

Class Inheritance Diagram

gafaelfawr.storage.oidc Module

Storage for OpenID Connect authorizations.

Classes

OIDCAuthorizationStore(storage)

Stores and retrieves OpenID Connect authorizations.

Class Inheritance Diagram

gafaelfawr.storage.token Module

Storage for tokens.

Classes

TokenDatabaseStore(session)	Stores and manipulates tokens in the database.
TokenRedisStore(storage, logger)	Stores and retrieves token data in Redis.

Class Inheritance Diagram

gafaelfawr.templates Module

Templated responses.

Since the primary UI is provided by JavaScript, these are generally used only for error messages.

Variables

templates

The template manager.

gafaelfawr.util Module

General utility functions.

Functions

add_padding(encoded)	Add padding to base64 encoded bytes.
base64_to_number(data)	Convert base64-encoded bytes to an integer.
is_bot_user(username)	Return whether the given username is a bot user.
normalize_ip_address(v)	Pydantic validator for IP address fields.
normalize_scopes(v)	Pydantic validator for scope fields.
normalize_timedelta(v)	Pydantic validator for timedelta fields.
number_to_base64(data)	Convert an integer to base64-encoded bytes in big endian order.
random_128_bits()	Generate random 128 bits encoded in base64 without padding.