components Package

base Module

Implements components and boot-steps.

This file was copied and adapted from celery.

copyright:

3. 2009 - 2012 by Ask Solem.

license:

BSD, see LICENSE for more details.

class thriftpool.components.base.Component(parent, **kwargs)

Bases: thriftpool.components.base.NewBase

A component.

The __init__() method is called when the component is bound to a parent object, and can as such be used to initialize attributes in the parent object at parent instantiation-time.

abstract = None

if set the component will not be registered, but can be used as a component base class.

create(parent)

Create the component.

enabled = True

This provides the default for include_if().

include(parent)

include_if(parent)

An optional predicate that decided whether this component should be created.

instantiate(qualname, *args, **kwargs)

last = False

This flag is reserved for the workers Consumer, since it is required to always be started last. There can only be one object marked with last in every namespace.

name = None

The name of the component, or the namespace and the name of the component separated by dot.

namespace = None

can be used to specify the namespace, if the name does not include it.

obj = None

Optional obj created by the create() method. This is used by StartStopComponents to keep the original service object.

requires = ()

List of component names this component depends on. Note that the dependencies must be in the same namespace.

class thriftpool.components.base.ComponentType

Bases: type

Metaclass for components.

class thriftpool.components.base.Namespace(name=None, app=None)

Bases: thriftpool.utils.mixin.LogsMixin

A namespace containing components.

Every component must belong to a namespace.

When component classes are created they are added to the mapping of unclaimed components. The components will be claimed when the namespace they belong to is created.

Parameters:

• name – Set the name of this namespace.
• app – Set the Celery app for this namespace.

apply(parent, **kwargs)

Apply the components in this namespace to an object.

This will apply the __init__ and include methods of each components with the object as argument.

For StartStopComponents the services created will also be added the the objects components attribute.

bind_component(name, parent, **kwargs)

Bind component to parent object and this namespace.

import_module(module)

load_modules()

Will load the component modules this namespace depends on.

modules()

Subclasses can override this to return a list of modules to import before components are claimed.

name = None

class thriftpool.components.base.StartStopComponent(parent, **kwargs)

Bases: thriftpool.components.base.Component

abort()

include(parent)

start()

stop()

terminable = False

terminate()

broker Module

Execute external commands by this worker.

class thriftpool.components.broker.PerspectiveBroker(app, controller)

Bases: thriftpool.utils.mixin.LogsMixin, thriftworker.utils.mixin.LoopMixin

Execute commands provided through pipe.

consumer

incoming_stream

outgoing_stream

start

stop

streams

class thriftpool.components.broker.PerspectiveBrokerComponent(parent, **kwargs)

Bases: thriftpool.components.base.StartStopComponent

create(parent)

name = 'broker'

namespace = 'worker'

requires = ('loop', 'acceptors', 'worker')

class thriftpool.components.broker.Stream(loop, fd)

Bases: object

Wrapper for plain file descriptor.

start()

stop(all_events=False)

subscribe(listener)

unsubscribe(listener)

write(data)

listeners Module

Contains component that hold listener pool.

class thriftpool.components.listeners.ListenersComponent(parent, **kwargs)

Bases: thriftpool.components.base.StartStopComponent

create(parent)

name = 'listeners'

namespace = 'manager'

class thriftpool.components.listeners.ListenersManager(app, listeners, processes)

Bases: thriftpool.utils.mixin.LogsMixin

start()

Start all registered listeners.

stop()

Stop all registered listeners.

class thriftpool.components.listeners.ListenersManagerComponent(parent, **kwargs)

Bases: thriftpool.components.base.StartStopComponent

create(parent)

name = 'listeners_manager'

namespace = 'manager'

requires = ('loop', 'listeners', 'process_manager')

loop Module

class thriftpool.components.loop.BaseLoopComponent(parent, **kwargs)

Bases: thriftpool.components.base.StartStopComponent

create(parent)

processes Module

Manage process pool.

class thriftpool.components.processes.BaseClientHandler(application, request, **kwargs)

Bases: thriftpool.components.processes.BaseHandler

get(*args)

get_data(proxy)

class thriftpool.components.processes.BaseHandler(application, request, **kwargs)

Bases: gaffer.http.util.CorsHandler

initialize(clients)

class thriftpool.components.processes.ClientsHandler(application, request, **kwargs)

Bases: thriftpool.components.processes.BaseHandler

get()

class thriftpool.components.processes.CounterHandler(application, request, **kwargs)

Bases: thriftpool.components.processes.BaseClientHandler

get_data(proxy)

class thriftpool.components.processes.ProcessManager(app, listeners, controller)

Bases: thriftpool.utils.mixin.LogsMixin, thriftworker.utils.mixin.LoopMixin

Start and manage workers.

abort()

get_start_time(process_id)

When process was registered?

gevent_monkey = 'from gevent.monkey import patch_all; patch_all();'

initialized

All workers started or not?

manager

name_template = '[thriftworker-{0}] -c {1.CONCURRENCY} -k {1.WORKER_TYPE}'

process_name = 'worker'

script = 'from thriftpool.bin.thriftworker import main; main();'

start()

stop()

class thriftpool.components.processes.ProcessManagerComponent(parent, **kwargs)

Bases: thriftpool.components.base.StartStopComponent

create(parent)

name = 'process_manager'

namespace = 'manager'

requires = ('loop', 'listeners')

class thriftpool.components.processes.RedirectStream(loop, stream)

Bases: object

Try to write to stream asynchronous.

write(data)

Write data in asynchronous way.

class thriftpool.components.processes.StackHandler(application, request, **kwargs)

Bases: thriftpool.components.processes.BaseClientHandler

get_data(proxy)

class thriftpool.components.processes.TimerHandler(application, request, **kwargs)

Bases: thriftpool.components.processes.BaseClientHandler

get_data(proxy)

worker Module