Commit Graph

19 Commits

Author SHA1 Message Date
Shokara Kou cfbd4d78ee save items in a Maildir/
rssdl is back in a usable state! (for rss only)
2022-12-10 22:34:54 -05:00
Shokara Kou 5f0aa201fc convert date format appropriate for emails 2022-12-10 21:44:32 -05:00
Shokara Kou 611f1b4ff7 replace tmp_fp with item.desc 2022-12-10 21:07:14 -05:00
Shokara Kou 186dd048d3 store title, link, and date in struct 2022-12-10 20:26:38 -05:00
Shokara Kou eb2c59173c remove old files to prepare for rewrite 2022-12-10 20:06:28 -05:00
Shokara Kou 9d33df4f1e fix clang warning for including yxml.h 2021-12-13 19:02:23 -05:00
Shokara Kou 7a859d2fe1 save items, but now with yxml :D 2021-12-13 17:38:34 -05:00
Shokara Kou 64667ff29e parse feed title and item's title, date, and link
RSS feed parsing needs to be fixed.
Atom feed items with multiple links (like one for a favicon) also
get parsed and those need to be skipped.
2021-12-13 12:45:32 -05:00
Shokara Kou d83d056fd7
remove isatom argument from parse_item() 2021-07-06 22:32:24 -04:00
Shokara Kou 30898d6a69
use open_memstream(3) instead of reinventing the wheel 2021-07-06 20:38:19 -04:00
Shokara Kou a43fdff052
temp commit 2021-07-01 20:50:49 -04:00
Shokara 9e6c8c25a0
start moving parser from mxml to yxml
mxml had a problem (bug?) which ignored a tag's CDATA if that tag
started with whitespace. This caused problems with the items of some
feeds like Dig Deeper's atom feed where items had empty
descriptions/summaries.

Initially, I also tried moving to expat which is a popular xml parser
that is also installed as part of most systems, probably as a
dependency of another program, but it seemed a bit difficult to
include. Meanwhile, yxml is another stream-based xml parser that is
simpler and only includes the bare minimum of what I need, so I'm using
it instead.

libxml2 wasn't considered because I think it's gomblex and very bloated,
even if it was easy to use.
2021-05-20 12:07:32 -04:00
Shokara 182a2dae65
add preliminary atom feed support
Currently, summary and maybe content tags with CDATA don't get saved,
but everything else appears to work (for now at least).
2021-03-26 13:44:07 -04:00
Shokara d99a3565c3
get feed's title directly without helper function 2021-03-10 23:50:59 -05:00
Shokara f037e26691
replace mbox with maildir + some refactoring 2021-03-05 14:41:27 -05:00
Shokara d38bffc537
write description directly to struct
This way tmpdesc wouldn't need to be duplicated and later reassigned to
the rss_item struct's desc variable.
2021-02-14 20:00:21 -05:00
Shokara 4b0d42b8a3
save RSS feed items into a directory from argv[2]
Currently overwrites items that were sent on the same time as another.
2020-11-28 18:56:59 -05:00
Shokara 5cc184bbea
split rss feed and item detail saving from parse()
Originally was all done in parse() but I want to move away from that to
make it easier to be able to save the content of the structs into files
later.
2020-11-26 17:44:33 -05:00
Shokara 4c04bb71f3
get an RSS feed's title and description
Using mini-xml instead of expat to parse the RSS XML.
Need to store them in structs now and get each feed's items contents.
2020-11-20 23:25:36 -05:00