[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: Aggregating container logs using Kibana





On Tue, Apr 5, 2016 at 7:00 AM, Lorenz Vanthillo <lorenz vanthillo outlook com> wrote:
I'm on origin 1.1.3

I followed this tutorial: https://docs.openshift.org/latest/install_config/aggregate_logging.html
I'm able to access kibana in my browser but it shows: No Results found :(

I checked the logs of my pods and I remarked an issue with my:
logging curator
logging fluentd (2 pods)

Is it normal that those pods aren't under a service?

Yes, it's normal; they're workers, no need to access them.
 

logs of curator:
logging-curator running [1] jobs
2016-04-05 10:54:09,281 ERROR Connection failure.
logging-curator run finish


Normal to see one of these up front while ES is coming up.
 

logs of fluentd:
2016-04-05 10:55:08 +0000 [error]: fluentd main process died unexpectedly. restarting.
2016-04-05 10:55:13 +0000 [error]: unexpected error error_class=Errno::EACCES error=#<Errno::EACCES: Permission denied - /var/log/es-containers.log.pos>

This looks like https://github.com/openshift/origin-aggregated-logging/issues/89 - keeps fluentd from reading any logs on the node.

You should be able to resolve this by adding the fluentd service account to the privileged SCC, then having fluentd restart everywhere.

 oadm policy add-scc-to-user privileged system:serviceaccount:logging:aggregated-logging-fluentd
Or, alternatively, patch SELinux policy. Or run in permissive mode. I'd advise the SCC change for simplicity.

I'll put in a PR soon to have the instructions say to use the privileged SCC as an interim fix.

 
2016-04-05 10:55:13 +0000 [error]: /opt/app-root/src/gems/fluentd-0.12.22/lib/fluent/plugin/in_tail.rb:97:in `initialize'
2016-04-05 10:55:13 +0000 [error]: /opt/app-root/src/gems/fluentd-0.12.22/lib/fluent/plugin/in_tail.rb:97:in `open'
2016-04-05 10:55:13 +0000 [error]: /opt/app-root/src/gems/fluentd-0.12.22/lib/fluent/plugin/in_tail.rb:97:in `start'
2016-04-05 10:55:13 +0000 [error]: /opt/app-root/src/gems/fluentd-0.12.22/lib/fluent/root_agent.rb:115:in `block in start'
...
repeat

Thanks

_______________________________________________
users mailing list
users lists openshift redhat com
http://lists.openshift.redhat.com/openshiftmm/listinfo/users



[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]