Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread Kalle Korhonen
On Mon, Jan 19, 2015 at 1:26 PM, Thiago H de Paula Figueiredo < thiag...@gmail.com> wrote: > On Mon, 19 Jan 2015 19:05:49 -0200, George Christman < > gchrist...@cardaddy.com> wrote: > >> Well that is what I'm currently doing, but the problem I'm facing is >> the app generates millions of pages and

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread Thiago H de Paula Figueiredo
On Mon, 19 Jan 2015 19:05:49 -0200, George Christman wrote: Well that is what I'm currently doing, but the problem I'm facing is the app generates millions of pages and your only allowed to have 50k per sitemap. Not really a problem. See http://www.sitemaps.org/protocol.html, section Usin

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread George Christman
This is what I'm currently doing but it isn't working very well do to the size of these things. public StreamResponse onActivate(String categoryType) { UrlSet urlset = new UrlSet(); List results = crudDAO.getAll(ZipDetail.class); for (ZipDetail zipDetail : results) {

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread George Christman
Well that is what I'm currently doing, but the problem I'm facing is the app generates millions of pages and your only allowed to have 50k per sitemap. So that is the first major issue I'm facing which this library addresses. I was hoping to put this on a nightly task so a search engine wouldn't be

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread Thiago H de Paula Figueiredo
On Mon, 19 Jan 2015 18:41:31 -0200, George Christman wrote: Caused by: java.io.FileNotFoundException: /sitemap.xml (Permission denied) Here's the cause: you're trying to write a file to the root folder of your filesystem. Sitemaps are simple, so why don't you write a Tapestry page to g

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread George Christman
Hi Thiago, I actually just stumbled upon the sitemapgen4j library and yes I'm using maven. https://code.google.com/p/sitemapgen4j/ java doc http://sitemapgen4j.googlecode.com/svn-history/r7/site/javadoc/com/redfin/sitemapgenerator/WebSitemapGenerator.html#WebSitemapGenerator%28java.lang.String,%2

Re: How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread Thiago H de Paula Figueiredo
On Mon, 19 Jan 2015 17:13:26 -0200, George Christman wrote: Hi guys, I'm looking to build nightly sitemaps and make them available publicly. The problem I'm facing is once I create the sitemap, where do I put it so that it's available publicly? The root context folder (/src/main/webapp if y

How to build xml sitemap with cron job and make available publicly

2015-01-19 Thread George Christman
Hi guys, I'm looking to build nightly sitemaps and make them available publicly. The problem I'm facing is once I create the sitemap, where do I put it so that it's available publicly? Currently it's available in the Web Pages package where it has some links in the root xml file that points to dyna