I ended up putting all my custom Pipelines on the "Default stream" under "System/Pipelines" to get it working. Just posting the followup in case it helps anyone else.
-- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to graylog2+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/95613659-caaf-4273-b13c-0eee237d1bad%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.