On Fri, Aug 19, 2016 at 04:05:18PM +0100, Lars van der Bijl wrote:
accounting only gives me data after the fact. I would like to know while
the machine accepts the task so i can visualise the progress to my artists.
We've written a very slim Python JSV wrapper that dumps information at *job
submit time* to a log file, which we ship off to Splunk for later
analysis and dashboards. We also dump accounting logs into Splunk,
which is also useful.
Pushing the data to $insert_database_here instead of a log file in a JSV
should be pretty simple as well.
On Fri, Aug 19, 2016 at 3:53 PM, Reuti <re...@staff.uni-marburg.de> wrote:
Hi,
> Am 19.08.2016 um 15:58 schrieb Lars van der Bijl <com48...@gmail.com>:
>
> hey all,
>
> I'm trying to parse the reporting file and parse this data into a
mongodb.
What is the goal of this effort? There is also the accounting file which
contains the execd the job was executed on (`man accounting`).
-- Reuti
> in the reporting with the joblog on we get message that look like:
>
> 1471613763:job_log:1471613763:sent:203471:1140:NONE:t:
master:qmaster:0:924:1471613584:jobname:lars:users:job:defaultdepartment:sge:sent
to execd
>
> 1471613763:job_log:1471613763:delivered:203471:1140:NONE:r:
master:qmaster:0:974:1471613458:jobname:lars:users:job:defaultdepartment:sge:job
received by execd
>
> looking at the code of Son of Grid Engine I see a reference to
qualified_hostname being given to reporting_create_job_log. but this is
the qmaster.
>
> would it be possible to add the execd it was sent to?
>
> or. is there a better way to get a detailed view of the cluster I can
parse and update my own database with?
> _______________________________________________
> users mailing list
> users@gridengine.org
> https://gridengine.org/mailman/listinfo/users
_______________________________________________
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
--
Jesse Becker (Contractor)
_______________________________________________
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
