Commit graph

57 commits

Author SHA1 Message Date
Andreas Schildbach
806100c868 Guava: Use Charsets constants. 2015-01-29 00:33:39 +01:00
Andreas Schildbach
64df076576 Remove obsolete ParserUtils.selectNotNull(). 2015-01-25 10:26:21 +01:00
Andreas Schildbach
20d63e21c4 Add another magic string for internal server errors. 2015-01-25 10:14:09 +01:00
Andreas Schildbach
d69506b7c1 Configure session cookies for scraping. 2015-01-09 18:42:32 +01:00
Andreas Schildbach
55a30f56de Clean up scrape methods. 2015-01-09 18:42:17 +01:00
Andreas Schildbach
05e3ac96cd Update user agent. 2015-01-09 17:44:52 +01:00
Andreas Schildbach
06a0d12b0f Update year of copyright. 2015-01-01 01:52:27 +01:00
Antonio El Khoury
a136e7911b Paris provider based on abstract Navitia provider. 2014-11-30 15:59:20 +01:00
Andreas Schildbach
d161b19907 Increase peek size and clean up size constants. 2014-09-18 10:43:01 +02:00
Andreas Schildbach
110f48ac81 Update user agent to Android Chrome browser. 2014-09-05 20:06:35 +02:00
Andreas Schildbach
e897787d09 Fix StringIndexOutOfBoundsException when scraped page is empty. 2014-08-14 23:56:15 +02:00
Andreas Schildbach
11a8d9f8fe Check for internal errors advertised as HTTP status OK. 2014-08-14 23:53:40 +02:00
Andreas Schildbach
bff85b9f6c Use our own exception type for HTTP_NOT_FOUND, rather than reusing FileNotFoundException. 2014-07-24 11:59:11 +02:00
Andreas Schildbach
0999b3ba7f Extract AbstractHttpException from HTTP related exceptions and provide access to error content. 2014-07-24 11:59:11 +02:00
Andreas Schildbach
1643e12e24 Update user agent. 2014-07-24 11:59:11 +02:00
Andreas Schildbach
f268772820 Move test for expired session into ParserUtils 2014-07-05 19:50:12 +02:00
Andreas Schildbach
6c02caf0f4 Parse disruptions of binary trips result (Hafas). 2014-07-05 19:50:12 +02:00
Andreas Schildbach
12e08bbb40 When scraping, detect several alternative forms of redirects. 2014-07-01 22:05:48 +02:00
Andreas Schildbach
5e47d29312 Handle HTTP status '401 UNAUTHORIZED'. 2014-07-01 21:57:47 +02:00
Andreas Schildbach
27894dbf78 Make ParserUtil.scrape() use .scrapeInputStream(). It duplicated a lot of code. Add testcase for detecting redirect by http-equiv meta tag. 2014-07-01 21:57:47 +02:00
Andreas Schildbach
4591eede54 Append first few characters of binary trips result (Hafas) to exception, for debug purposes. 2014-07-01 21:57:47 +02:00
Andreas Schildbach
84d47b6202 Use FileNotFoundException in favour of own NotFoundException on HTTP status "not found". 2014-06-18 13:54:13 +02:00
Andreas Schildbach
7fcaf904dd Make sure scraped input streams are always buffered, so they can be peeked into. 2014-06-18 13:54:13 +02:00
Andreas Schildbach
7e0d3d3c18 Update user agent. 2014-06-18 12:32:20 +02:00
Andreas Schildbach
172e0590d6 Introduce exception for internal server errors. 2014-03-23 13:51:34 +01:00
Andreas Schildbach
3fa417cbe8 Update user agent 2014-01-20 17:28:29 +01:00
Andreas Schildbach
23489327b1 Update year of copyright 2014-01-12 00:44:10 +01:00
Andreas Schildbach
6c7b7137a8 Handle HTTP status 'not available' 2013-12-04 23:51:48 +01:00
Andreas Schildbach
f28109c5aa Handle more cases of HTTP redirect 2013-10-26 23:21:06 +02:00
Andreas Schildbach
2efd86ebf8 Update user agent 2013-08-18 20:39:37 +02:00
Andreas Schildbach
853a6904ab fix parsing departure dates in Austria 2013-06-28 21:25:55 +02:00
Andreas Schildbach
d1a23d7fdb fix Bavaria by implementing mobile efa protocol 2013-06-20 12:29:25 +02:00
Andreas Schildbach
287c84454f interpret HTTP_NOT_FOUND as expired session when querying for more connections 2013-06-14 11:12:36 +02:00
Andreas Schildbach
96fe89286c do not retry on http status 406 2013-03-14 08:40:23 +01:00
Andreas Schildbach
fdb905c195 update user agent 2013-03-14 08:40:02 +01:00
Andreas Schildbach
e6b94d163a fix detection of refresh meta tag 2013-03-12 17:23:57 +01:00
Andreas Schildbach
ee6199ce1c also parse itdTrain in itdServingLine for efa based providers 2013-02-15 11:34:28 +01:00
Andreas Schildbach
8a3045f229 fixed not setting accept header for certain requests 2013-02-15 11:34:28 +01:00
Andreas Schildbach
6dfe6a2874 update user agent 2013-02-15 11:34:27 +01:00
Andreas Schildbach
0e7be5280f exception for blocked requests 2013-01-05 13:41:11 +01:00
Andreas Schildbach
36ff83f79c update year of copyright 2013-01-01 13:46:57 +01:00
Andreas Schildbach
aa2920cff1 avoid using non-ascii characters in source code 2012-10-01 11:33:02 +02:00
Andreas Schildbach
8eb6c04b02 use correct referer for Wien 2012-09-20 16:04:04 +02:00
Andreas Schildbach
6ac291eb5f allow redirect if staying on same host 2012-09-20 16:04:04 +02:00
Andreas Schildbach
c03fe78c78 support 'h2g-direct' binary format for hafas connections 2012-08-06 13:04:39 +02:00
Andreas Schildbach
051ff66460 fixed usage of Java6 api 2012-07-22 11:27:32 +02:00
Andreas Schildbach
7bd04825ef fixed calculation of content-length request header 2012-07-21 16:23:14 +02:00
Andreas Schildbach
ddd6f95336 more gzip handling 2012-07-12 12:46:19 +02:00
Andreas Schildbach
194c6295e4 fixed request encoding when autocompleting hafas 2012-07-08 13:17:16 +02:00
Andreas Schildbach
c5bdc06763 support Ireland and Dublin 2012-06-20 19:25:39 +02:00