Hey Darwin, you don't mention your version or config, but it's always good to go through https://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server
I used to notice huge improvements in plans when increasing statistics in relevant columns, as already suggested by David, and also by lowering random_page_cost, especially in older Pg versions.
