Hong
Thanks.
What else is needed to get all of GAMG setup onto the GPU and running as
well as it can? Any more GPU kernels? Or is just tweaking the infrastucture,
the kernels are already done? Will we see pure GPU GAMG soon?
I think we should start porting the PetscFE infrastructure, numerical
integrations, vector and matrix assembly to GPUs soon. It is dog slow on CPUs
and should be able to deliver higher performance on GPUs.
Others?
Barry
And no, this is not the time for arguing GPUs suck and some things are best
done on CPUs or that DOE should not have bought GPU machines. It is about
getting the best performance we can from a set of systems we will have
available.
> On Mar 12, 2021, at 5:43 PM, Zhang, Hong <[email protected]> wrote:
>
>
>
>> On Mar 12, 2021, at 5:25 PM, Barry Smith <[email protected]
>> <mailto:[email protected]>> wrote:
>>
>>
>> Jed,
>>
>> Thanks for the insight.
>>
>> Maybe Hong and his Ellpack format? Or his independent set algorithm?
>
> These two features are currently functional on NVIDIA GPUs. Neither needs
> extensive development or refactorization, thus not suitable for this Argonne
> GPU Hackathon. But we do need reviewers to look at the two MRs and move
> forward.
>
> It is also worth mentioning that the CUDA-based maximal independent set
> algorithm was developed during last GPU Hackathon at ORNL. Richard, Junchao
> and I attended that one. It was a great experience. The commitment is
> extremely intensive for both the mentors and the attendees.
>
> Thanks,
> Hong
>
>>
>> Maybe Stefano and his COO matrix assembly on GPUs?
>>
>> Others?
>>
>> Barry
>>
>>
>>> On Mar 12, 2021, at 4:37 PM, Jed Brown <[email protected]
>>> <mailto:[email protected]>> wrote:
>>>
>>> I helped with one of these a couple years ago. It's important to go in with
>>> a well-defined problem and mini-app. If "PETSc" is the topic, then you
>>> should start with a representative benchmark problem that runs in no more
>>> than a couple minutes. It could be two problems, one that we think is good
>>> and one that we think is weak. The format is good for incrementally
>>> profiling and refactoring existing code. Probably less so for doing careful
>>> implementations of genuinely novel algorithms. (And if you plan to do that,
>>> make sure there's a way that the one person focused on that lift doesn't
>>> block the rest of the team.)
>>>
>>> Barry Smith <[email protected] <mailto:[email protected]>> writes:
>>>
>>>> Folks,
>>>>
>>>> Get was able to get us into the ANL GPU hackathon that will use the
>>>> "theta" GPU system at ANL (that has NVIDIA GPUs). ALCF accounts are
>>>> needed for the hackathon (but can be created). Registration information is
>>>> below. If we go with specific goals it could be a useful experience.
>>>>
>>>> Barry
>>>>
>>>>
>>>>
>>>>> Begin forwarded message:
>>>>>
>>>>> From: Andi Moore <[email protected] <mailto:[email protected]>>
>>>>> Subject: Argonne GPU Virtual Hackathon - Accepted
>>>>> Date: March 11, 2021 at 5:09:02 PM CST
>>>>> To: "[email protected] <mailto:[email protected]>" <[email protected]
>>>>> <mailto:[email protected]>>, "[email protected] <mailto:[email protected]>"
>>>>> <[email protected] <mailto:[email protected]>>, "[email protected]
>>>>> <mailto:[email protected]>" <[email protected] <mailto:[email protected]>>
>>>>> Cc: "Ghadar, Yasaman" <[email protected] <mailto:[email protected]>>, Julia
>>>>> Levites <[email protected] <mailto:[email protected]>>
>>>>> Message-Id:
>>>>> <mw3pr12mb4588bf988609b8f7a49f6a21b3...@mw3pr12mb4588.namprd12.prod.outlook.com
>>>>>
>>>>> <mailto:mw3pr12mb4588bf988609b8f7a49f6a21b3...@mw3pr12mb4588.namprd12.prod.outlook.com>>
>>>>>
>>>>> Dear Team Barry Smith,
>>>>>
>>>>> Congratulations! Your team has been selected to participate in the
>>>>> Argonne GPU Virtual Hackathon.
>>>>>
>>>>> The next steps:
>>>>>
>>>>> Registration
>>>>> Each team member is required to register for the event. Please click here
>>>>> <https://www.gpuhackathons.org/form/gpu-event-registration
>>>>> <https://www.gpuhackathons.org/form/gpu-event-registration>> to register
>>>>> and select the Hackathon from the drop-down menu. Please register as soon
>>>>> as possible.
>>>>>
>>>>> Mentors
>>>>> Mentors are being selected for each team based on your research fields
>>>>> and coding needs. An introductory call for teams and mentors has been
>>>>> scheduled for Wednesday, April 7th, details below.
>>>>>
>>>>> System Access
>>>>> Request an ALCF Computer User Account <https://accounts.alcf.anl.gov/
>>>>> <https://accounts.alcf.anl.gov/>> if you do not currently have one. If
>>>>> you have an ALCF account, but it is currently inactive, reactivate
>>>>> <https://accounts.alcf.anl.gov/#!/accountReactivate
>>>>> <https://accounts.alcf.anl.gov/#!/accountReactivate>> your account.
>>>>> Specify the following in the account request/reactivation form:
>>>>> Project Name: gpu_hack
>>>>> Principal Investigator (PI): Yasaman Ghadar
>>>>>
>>>>> Contact [email protected] <mailto:[email protected]>
>>>>> <mailto:[email protected] <mailto:[email protected]>> if you have
>>>>> questions about your ALCF account.
>>>>>
>>>>> Additional information
>>>>> Review the GPU Hackathon Virtual Attendee Guide
>>>>> <https://docs.google.com/document/d/1M7vacg0GLg38gsJYHOg2tM_M0QArOSCrPiLaQER9hzg/edit?usp=sharing
>>>>>
>>>>> <https://docs.google.com/document/d/1M7vacg0GLg38gsJYHOg2tM_M0QArOSCrPiLaQER9hzg/edit?usp=sharing>>
>>>>> Review the technical resources website
>>>>> <https://www.gpuhackathons.org/technical-resources
>>>>> <https://www.gpuhackathons.org/technical-resources>> which will help you
>>>>> prepare for the hackathon. The page includes information about profiling
>>>>> tools, compilers, libraries, programming models and more.
>>>>>
>>>>> Slack
>>>>> All communication for the event will occur through the Slack workspace
>>>>> Please join
>>>>> <https://join.slack.com/t/argonnehack2021/shared_invite/zt-nfio2vwz-f0UeYdXVmoRLKUIBgLy_FA
>>>>>
>>>>> <https://join.slack.com/t/argonnehack2021/shared_invite/zt-nfio2vwz-f0UeYdXVmoRLKUIBgLy_FA>>
>>>>> the Slack workspace
>>>>>
>>>>> Agenda - All calendar invites are attached
>>>>> Argonne GPU Hackathon Team and Mentor Meeting: 2:00PM-3:00PM CST – April
>>>>> 7, 2021 Zoom Link
>>>>> <https://zoom.us/j/93527581258?pwd=S01GZVAxS3hLVCsvc0wyR2s2MHJEZz09
>>>>> <https://zoom.us/j/93527581258?pwd=S01GZVAxS3hLVCsvc0wyR2s2MHJEZz09>>
>>>>>
>>>>> Argonne GPU Hackathon Day 1: 9:00AM-5:00PM CST – April 20, 2021 Zoom Link
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09>>
>>>>>
>>>>> Argonne GPU Hackathon Day 2: 9:00AM-5:00PM CST April 27, 2021 Zoom Link
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09>>
>>>>>
>>>>> Argonne GPU Hackathon Day 3: 9:00AM-5:00PM CST April 28, 2021 Zoom Link
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09>>
>>>>>
>>>>> Argonne GPU Hackathon Day 4: 9:00AM-5:30PM CST April 29, 2021 Zoom Link
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09
>>>>> <https://zoom.us/j/94645872736?pwd=UmtNakprSjB6WmFVUVdoZUMvdDFIUT09>>
>>>>>
>>>>>
>>>>> Please feel free to ask any questions you may have. Thank you all for
>>>>> your interest and outstanding applications!
>>>>>
>>>>> Best regards,
>>>>> The GPU Hackathon Team
>>
>
