On Thu, Apr 03, 2014 at 05:40:17PM +0200, Vlastimil Babka wrote: > For the MIGRATE_RESERVE pages, it is important they do not get misplaced > on free_list of other migratetype, otherwise the whole MIGRATE_RESERVE > pageblock might be changed to other migratetype in try_to_steal_freepages(). > > Currently, it is however possible for this to happen when MIGRATE_RESERVE > page is allocated on pcplist through rmqueue_bulk() as a fallback for other > desired migratetype, and then later freed back through free_pcppages_bulk() > without being actually used. This happens because free_pcppages_bulk() uses > get_freepage_migratetype() to choose the free_list, and rmqueue_bulk() calls > set_freepage_migratetype() with the *desired* migratetype and not the page's > original MIGRATE_RESERVE migratetype. > > This patch fixes the problem by moving the call to set_freepage_migratetype() > from rmqueue_bulk() down to __rmqueue_smallest() and __rmqueue_fallback() > where > the actual page's migratetype (e.g. from which free_list the page is taken > from) is used. Note that this migratetype might be different from the > pageblock's migratetype due to freepage stealing decisions. This is OK, as > page > stealing never uses MIGRATE_RESERVE as a fallback, and also takes care to > leave > all MIGRATE_CMA pages on the correct freelist. > > Therefore, as an additional benefit, the call to get_pageblock_migratetype() > from rmqueue_bulk() when CMA is enabled, can be removed completely. This > relies > on the fact that MIGRATE_CMA pageblocks are created only during system init, > and the above. The related is_migrate_isolate() check is also unnecessary, as > memory isolation has other ways to move pages between freelists, and drain > pcp lists containing pages that should be isolated. > The buffered_rmqueue() can also benefit from calling > get_freepage_migratetype() > instead of get_pageblock_migratetype(). > > A separate patch will add VM_BUG_ON checks for the invariant that for > MIGRATE_RESERVE and MIGRATE_CMA pageblocks, freepage_migratetype must equal to > pageblock_migratetype so that these pages always go to the correct free_list. > > Reported-by: Yong-Taek Lee <ytk....@samsung.com> > Reported-by: Bartlomiej Zolnierkiewicz <b.zolnier...@samsung.com> > Suggested-by: Joonsoo Kim <iamjoonsoo....@lge.com> > Suggested-by: Mel Gorman <mgor...@suse.de> > Cc: Minchan Kim <minc...@kernel.org> > Cc: KOSAKI Motohiro <kosaki.motoh...@jp.fujitsu.com> > Cc: Marek Szyprowski <m.szyprow...@samsung.com> > Cc: Hugh Dickins <hu...@google.com> > Cc: Rik van Riel <r...@redhat.com> > Cc: Michal Nazarewicz <min...@mina86.com> > Signed-off-by: Vlastimil Babka <vba...@suse.cz>
Looks good to me. Acked-by: Joonsoo Kim <iamjoonsoo....@lge.com> -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
