severb / flowy Goto Github PK

Hello,

As your example in #17 , TaskError is raised because activity failed.
I try to implement subtask retry for sub-subtask failed, but I got SuspendTask, not TaskError.

Do you have any suggestion to implement subtask retry ?
Is it possible to get TaskError from sub-subtask failed ?

Thank you.

jinkuen

Hi @severb,

Do you plan on supporting the Lambda function calls ?

Cheers,
Pior

Hi!

I've been trying to select to region to run the activity and workflow workers but couldn't figure out how to do this. What's the idiomatic way of doing things?

I've found https://github.com/pbs/flowy/blob/aeabc8386158ec385e43562fdf098859731ab5a6/flowy/swf/boilerplate.py#L21 these in code, but couldn't find any reference of the _get_client helper in the code. Should I provide a specific Layer1 object already set up with the region I want to connect to the start_* functions or is there any other way?

Just let me know what's best, I can find a solution and send a Pull Request if you don't have time for this :)

Thanks!

Hello,

I try to start activity work in thread and SuspendTask exception raised.
It's easy to monitor two activity work list parallelly with subworkflow.
But monitor it in thread seems not a good idea.
Do you have any suggestion ?

Thank you.

Jin-Kuen

# example code

@workflow(version='0.1', task_list='default')
class MyWorkflow(Workflow):

    proxy = ActivityProxy(name='MyActivity', version='0.1',

    def __run_thread(self):
        with self.proxy.options(task_list='default'):
            task = self.proxy(*args)
            result = task.result()
            event.set()

    def __run(self):
        event = threading.Event()
        thread = threading.Thread(target=self.__run_thread)
        thread.start()
        event.wait()
        thread.join()
        return True

    def run(self, job_desc, service):
        self.__run()
        return True

Hi,

Does the current implementation support workflow/activity cancellation? If not, do you have a suggestion to achieve it?

Hi,

We're trying AWS SWF and the package, flowy, you created is a big help. It made us easy to write our own logic and validate it. Good job!

Look at the source code, you intend to let developer to handle activity error/timeout; it's okay. We just want to know do you have any good suggestion to handle activity error with flowy, especially for activities running on parallel? For example, we have (same) 10 activities (with different input) running and we want to re-run failed ones if any.

I apologize if this is not the right place to get some help.

Thanks,
Wesley

I came across a situation where if an Activity returned a string longer than 32768 bytes, the activity would time out, instead of properly reporting what was going on.
It would be nice if the error message would propagate instead as the task result, and the activity would close with the status FAILED.

Hi!

I've noticed while trying to go through the documentation tutorial that the version pushed on pypi was 0.1.9 while the master branch here on Github is at 0.1.5b.

Problem is the documentation instructions on read the docs seem to be made for the 0.1.5b and I can't find the boilerplate module in the version from pypi for example.

Can you figure something out? :)

Thank you very much!

Using them fails with the following error:
{u'message': u'Unknown execution: WorkflowExecution=[workflowId=94d40150-66b8-4232-a8bf-9fa8ff5f5ba9, runId=12Ow4iP9cUUKJhPfUP6zzJWy5I/Nn/fWqNviSIDdUQkgo=]', u'__type': u'com.amazonaws.swf.base.model#UnknownResourceFault'}

Amazon SWF provides a way for activities to return a status report with the detail parameter. Flowy's heartbeat function doesn't take params.

Flowy is a good framework to work with swf without concerning event type.

Since I try to build a generic workflow (decider) with job description to generate different workflow easily.
I need to trace workflow/sub-workflow/activity status change during execution time.

Is any suggestion to get events like WorkflowExecutionStarted / WorkflowExecutionCompleted / ChildWorkflowExecutionFailed in decider ?

Thank you.

jinkuen

Hi!

We're exploring a further flowy usage possibility, but it doesn't seem flowy already provides abstractions over the SWF signals system, which we heavily use here at @botify.

Do you have plans for this? Would you be interessed in discussing it and/or receiving Pull Requests?