Create an example of a python custom controller

[dimberman]

I am attempting to create an example custom controller using the python-client, but I cant seem to find any Informer (https://github.com/kubernetes/client-go/tree/master/informers) endpoint in client python. Am I missing this endpoint or has this not been added to the library yet?

If it does exist, I would very much like to contribute an example to encourage creation of custom controllers.

cc: @foxish @mbohlool

[mbohlool]

Informer is a client-go thing not a kubernetes API thing (as it is in client-go repo). An informer is basically a watch (example in python). Actually as far as I can tell, there is no Informer in kubernetes but sharedInformer that is a more advanced concept that we do not have in python client and if anybody wants to implement that, I would spend dedicated review time for them :)

[karmab]

is it enough to leverage the watch code ? what is specific to the shared informer?

[mbohlool]

shared informers has cache and connection sharing.

[mattmoor]

FYI I am adding a little sample in this PR to bazelbuild/rules_k8s.

[mattmoor]

Also I'm very open to feedback :)

[karmab]

@mattmoor thanks, this is exactly what i had in mind and was coming with (testing with tpr instead of crd but crds are the way to go)!

[karmab]

@mbohlool ok, if i were to implement shared informers in this python library, what would be the way to go ?

[mbohlool]

It would be basically an extension to Watch class to cache and share watch calls. It would be amazing if the interface of the class does not change and it would be smart enough to share an existing watch connection.

[karmab]

@mattmoor @dimberman i've also created https://github.com/karmab/samplecontroller if you wanna have a look

[mattmoor]

So my controller deployments aren't living terribly long. I was playing with a derivative of my example, and it is very slowly crash looping.

I'm not sure of the exact symptom, but I have seen messages about connection exhaustion (maybe a leak in the watch logic?).

Is there a more stable pattern than the one I'm using, or any useful debugging trick to better identify what's going on?

[karmab]

the following does the trick for me: ``` while True: if resource_version is None: stream = watch.Watch().stream(crds.list_cluster_custom_object, DOMAIN, "v1", "guitars") else: stream = watch.Watch().stream(crds.list_cluster_custom_object, DOMAIN, "v1", "guitars", resource_version=resource_version) for event in stream: obj = event["object"] operation = event['type'] spec = obj.get("spec") if not spec: print("No 'spec' in object, skipping event: %s" % json.dumps(obj, indent=1)) continue metadata = obj.get("metadata") resource_version = metadata['resourceVersion'] name = metadata['name'] print("Handling %s on %s" % (operation, name)) done = spec.get("review", False) if done: continue review_guitar(crds, obj) ```

[mattmoor]

@karmab I assume you mean the combination of the outer while True and the resource_version logic to avoid reprocessing? Is resource_version from a single object a reasonable thing to rely upon?

[karmab]

i was told by mehdi this was the way to go :)

[mattmoor]

@karmab I think that is more verbose than you need, try:

    resource_version = ''
    while True:
        stream = watch.Watch().stream(crds.list_cluster_custom_object,
                                      DOMAIN, VERSION, PLURAL,
                                      resource_version=resource_version)
        for event in stream:
            try:
                obj = event["object"]
                # Normal processing...

                # Configure where to resume streaming.                                                                                                                                           
                metadata = obj.get("metadata")
                if metadata:
                    resource_version = metadata["resourceVersion"]
            except:
                logging.exception("Error handling event")

I'm going to leave that running for a while and see if it does the trick :)