Wikisource talk:WS Export - Wikisource
Jump to content
From Wikisource
(Redirected from
Wikisource talk:WSexport
Latest comment:
3 months ago
by LaetusStudiis in topic
Site isn't working for English
Suggestions for improvement
edit
Localization of link
edit
The link added should be properly localized. As it is now, the link appears in one only language irrespectively of the interface language selected in the Users preferences. Compare with the link for exporting a PDF version, which changes if the user changes their language.
Parameters for flexibility
edit
Latest comment:
14 years ago
4 comments
2 people in discussion
Hi! Thank you for this great tool. I have been considering how we can use it to the best effect at English Wikisource, and I have some suggestions that would allow us to integrate the book-generation process with the existing PediaPress PDF tool, as well as allowing more unconventional collections of pages.
Firstly, the PediaPress tool operates on a simple list of pages, like this:
en:Wikisource:Books/Bull-dog Drummond
. We could use ws-summary and metadata microformats on this page to generate the book, but it will include the raw pages list, as well as the formatted contents contained in the work itself. Thus, my first suggestion is to accept a parameter "ignorelistpage" which will direct WSexport to harvest the links in the list, but not include the page in the final document.
This manual (but with a page-collector helper) listing method allow us to have separate works group together (for example, a collection of related scientific papers), allows works that are not all linked to a single front page (like newspapers) and allows us to have a curated collection of verified (and editable) books.
Secondly, if the metadata is included on the list page, that allows flexibility in unusual works (such as a compilation of separate works by many authors). However, for the common case where the information on a single page is sufficient, this duplication of data invites mistakes to creep in when pages are updated, but not the related book. Therefore, I propose a "metadatalocation" parameter, which directs WSexport to harvest metadata from another page.
I am working on a way to integrate this into a system more targeted at WSexport than the PediaPress extension, but I would need to know exactly what format the script would take the parameters before it could be completed. Thank you for your great work!
Inductiveload
03:06, 20 February 2012 (UTC)
Reply
For the ignorelistpage, no problem, it's a good idea ! I'll implement it. For the metadatalocation it's a little bit more complicated but I think it's possible. Thanks for your interest.
Tpt
20:32, 21 February 2012 (UTC)
Reply
Wonderful! I feel the ignorelistpage is the most important, as that means any pagelist that is not part of the work itself can be used easily. I have talked to the mwlib/PediaPress list, and it is unlikely that we can get enough "care" to have the Wikisource-specific metadata thing implemented any time soon (sounds like they have a lot of problems, and cate ring to Wikisource is not one of them), so I might try to knock a client-side one up myself. If you can't get an external metadata collection scheme working, it's not a huge crisis, it just means we'll need to keep an eye on diverging metadata. Thanks for the quick reply, I'll keep you informed of any useful progress I make on a book generator.
One thing that was mentioned in the list was the
Dublin Core
metadata system. Can you see any milage in the DC system, as compared to (or in addition to) the current WS microformat? Just food for thought. Cheers,
Inductiveload
19:05, 22 February 2012 (UTC)
Reply
The current WS microformat is inspired by
w:en:Dublin Core
that is not adapted to html content. The xhtml ouput of WSexport add dublin core metadata from the microformat. I'm working on a metadata system build with proofreadPage that will provide an api and add DublinCore in header of Wikisource pages. Here is a
quick description
of the the keys problems of the project.
Tpt
21:50, 26 February 2012 (UTC)
Reply
Implmenting in Wikibooks
edit
Latest comment:
13 years ago
3 comments
2 people in discussion
Hi,
I'm very interested in using this tool on wikibooks. At the moment the pdf exporter there is pretty poor and it would be great to get an epub exporter in place. Do you have any advice as to how this could be done. The book I want to convert is
here
Pluke
talk
11:39, 20 January 2013 (UTC)
Reply
Wsexport is currently design to work on Wikisource, so this tool is adapted to Wikisource specificity and some changes in its code is needed to make it work well for Wikibooks. It's not an impossible thing but I'll do it only if there is a strong request of the Wikibooks community.
Tpt
talk
20:01, 20 January 2013 (UTC)
Reply
Hi Tpt, I'd definitely have a use for it, I need to export
this
book:, I'll see if we can get a few more people interested. The current PDF export feature is pretty poor.
Pluke
talk
19:35, 22 January 2013 (UTC)
Reply
Running from command line
edit
Latest comment:
13 years ago
1 comment
1 person in discussion
I've just submitted a
pull request
for some little variation to the way in which paths are coded for the CLI bit of the WSexport tool. I'm working on a little thing that will let me keep my local ePub library up-to-date with Wikisource (updating books as they cange on WS). Does such a thing exist anywhere, does anyone know? Would it be of interest to anyone? And many thanks to tpt for a great tool!  :-)
Samwilson
talk
05:12, 19 March 2013 (UTC)
Reply
Implementing it for Wikipedia
edit
Latest comment:
10 years ago
1 comment
1 person in discussion
User:Tpt
., Thanks for this great tool, which is being used on Telugu wikisource. I find a need for this tool to work on Telugu wikipedia, where we would like to produce books on collection of featured articles or pages under a project. The Pediapress tool has bugs in rendering front cover for Telugu language and though the bug was reported, nothing much happened from Pediapress or WMF over the past few years. I also feel EPUB is a better for Telugu, as it allows search capability. Can you share your thoughts on how this can be expanded for use on Wikipedia and any tips for doing this, incase you are not able to spare your time soon.--
Arjunaraoc
talk
04:48, 11 May 2015 (UTC)
Reply
Research on the potential of Wikimedia content in EPUBS
edit
Latest comment:
9 years ago
1 comment
1 person in discussion
Hello Tpt, we are researchers from the
Publishing Lab
in Amsterdam. As part of our research we did some tests on certain tools that are used to export Wikimedia content to EPUBS and we were very happy to find your tool to be very effective. (
Researching Existing Tools
Here is the documentation of our ongoing research on Meta-Wiki:
Research on e-books with Wikimedia content
We would like to work on a tool that allows users to gather content from multiple Wikimedia projects and collect them in an EPUB. We are still at the beginning of the journey, so the specifics are not clear yet, but it would be great to have your input. We have a few questions about the tool.
Have you ever considered or worked on the possibility to develop WSexport further to collect content from multiple wikis and not just individual wiki projects? Did you encounter any difficulties?
We noticed that you worked on another instance of the WSexport that is browser based (
currently not available?). We were curious to know the differences between the two and what you find useful about having a browser based version.
Thanks for your time.
Cristina
Juan
13zhampu13
talk
10:40, 3 October 2016 (UTC)
Reply
Sex
port/Scunthorpe problem
edit
Latest comment:
6 years ago
3 comments
3 people in discussion
Tracked in
Phabricator
Task T266579
I suggest renaming this page slightly (i.e. separating the S and “export”) so that
overzealous web filters
don’t block it when they notice the “Sex” in the name.
JohnSmith13345
talk
10:02, 13 June 2019 (UTC)
Reply
Would
WsExport
do? --
Zyephyrus
talk
07:54, 14 June 2019 (UTC)
Reply
Zyephyrus
JohnSmith13345
: I think something more descriptive might be good, such as
Wikisource Export Tool
. I suggest the same change to the tool:
Sam
Wilson
00:28, 5 September 2019 (UTC)
Reply
Request : Book cover design
edit
Latest comment:
5 years ago
2 comments
2 people in discussion
Can you update this tool to add an option for excluding Book cover image from the output file. This photo is not suitable for all books titles.
Omda4wady
talk
12:56, 20 September 2020 (UTC)
Reply
Omda4wady
: Sorry for my slow reply. Do you mean an option to
only
exclude the cover image, but still include all other images? Or does the existing option to exclude images work okay? —
Sam
Wilson
05:52, 23 November 2020 (UTC)
Reply
Error emails
edit
Latest comment:
5 years ago
4 comments
2 people in discussion
Samwilson
: Hey there, haven't followed the development of the tool much but it looks like things are moving faster, which is great. I'm still listed as maintainer and recently started getting error notification emails: "[Wikisource Export TEST] Uncaught PHP Exception Symfony\Component". Where is this configured? –
Jberkel
talk
12:06, 18 November 2020 (UTC)
Reply
Jberkel
: sorry for my slow reply! These emails go to all maintainers, as configured in
. It's slightly misleading, in that we're using the wsexport maintainers list for the wsexport-test instance as well, just to make it easier than maintaining them separately. Hopefully the number of emails will decrease as we improve the tool! —
Sam
Wilson
05:51, 23 November 2020 (UTC)
Reply
Samwilson
: Ah ok, so not production errors? What's the test instance? Used for staging? –
Jberkel
talk
08:41, 23 November 2020 (UTC)
Reply
Jberkel
: No, there are lots of production errors too. :-/ There aren't actually any
new
errors, it's just that we've made the reporting system much more annoying! :) And yep, the test instance is the staging server; it's at
. —
Sam
Wilson
09:47, 23 November 2020 (UTC)
Reply
Broken wsexport
edit
Latest comment:
5 years ago
4 comments
2 people in discussion
Tracked in
Phabricator
Task T275967
The export function does not seem to work properly, chapters are not exported as part of the epubs or pdfs, rather only the table of contents is included and the about page
E7A986E4BA91
talk
01:59, 2 March 2021 (UTC)
Reply
E7A986E4BA91
: Thanks for reporting this. Which book are you getting this error with? —
Sam
Wilson
02:23, 2 March 2021 (UTC)
Reply
Samwilson
: Many pages, for example
E7A986E4BA91
talk
02:47, 3 March 2021 (UTC)
Reply
E7A986E4BA91
: Thanks! It looks like this has been reported as
Phabricator:T275967
. We'll follow up there soon. —
Sam
Wilson
02:57, 3 March 2021 (UTC)
Reply
Apostrophe in the title
edit
Latest comment:
4 years ago
2 comments
2 people in discussion
It seems that the WS Export does not work if there is an apostrophe in the title of the book.
See this example:
La Costa d'Avorio
, if you try to clink on the PDF link at the top of the page, it does not work.
Can someone check and solve this issue? Thanks, regards, --
Accurimbono
talk
10:24, 2 December 2021 (UTC)
Reply
Accurimbono
: It’s not a bug in the tool itself, but the template {{
Intestazione
}}—the blue
Scarica
button next to the page title works perfectly. I don’t know how the template works, but you should basically prevent it from HTML-encoding the page title. —
Tacsipacsi
talk
17:04, 2 December 2021 (UTC)
Reply
is down
edit
Latest comment:
3 years ago
4 comments
2 people in discussion
Maybe someone could bring it up again. --
Aschroet
talk
09:42, 18 April 2023 (UTC)
Reply
Aschroet
: Rebooting it now.
Sam
Wilson
09:45, 18 April 2023 (UTC)
Reply
Aschroet
: Done. It is up again. Sorry for the downtime!
Sam
Wilson
09:50, 18 April 2023 (UTC)
Reply
Thank you for the quick response, --
Aschroet
talk
09:56, 18 April 2023 (UTC)
Reply
It's down.
edit
Latest comment:
2 years ago
2 comments
2 people in discussion
Tracked in
Phabricator
Task T335553
And for a while now as well.
Ștefan Tărâță
talk
14:24, 27 April 2023 (UTC)
Reply
Ștefan Tărâță
:It's certainly been
down lately
more than usual, but it looks like it's back up now. Generally, this is due to excessive bot traffic. I've created
phab:T335553
to look at what's going on.
Sam
Wilson
01:29, 28 April 2023 (UTC)
Reply
Seems to be down again.
edit
Latest comment:
2 years ago
2 comments
2 people in discussion
The
website seems to be struggling lately... Many thanks in advance for bringing it back again !
Epigeneticist
talk
20:18, 12 June 2023 (UTC)
Reply
😢 At this point, is it ever gonna work again?
Eugrus
talk
19:54, 19 February 2024 (UTC)
Reply
Different output in export and in the web version
edit
Latest comment:
1 year ago
1 comment
1 person in discussion
The
ws-noexport
class may be used to display something in the web version but not in exported versions (PDF, ePub, etc). Is it possible to do the opposite, i.e display something in exports but not in the web version?
What I want to achieve is to display hyperlinks (
[[foo|a text]]
) in the web version and only the text (
a text
) in exports. I thought about something like this:
[[foo|a text]]a text
But
ws-exportonly
does not exist, as far as I know.
Seudo
talk
12:49, 14 June 2024 (UTC)
Reply
Contributor list
edit
Latest comment:
1 year ago
1 comment
1 person in discussion
The same about ten usernames appear in the contributions list on every book I export, even those I've just completed and that no one else has worked on. Is this a bug, or are these the devs, or something else?
Alien333
talk
17:14, 27 September 2024 (UTC)
Reply
Interwikis
edit
Latest comment:
1 year ago
2 comments
2 people in discussion
Tacsipacsi
: Can you please explain how only interwikis work, as right now I'm seeing two of each on this page, i.e. two to ca, two to en, two to fr, and two to ja. Thank you,
Alien333
talk
17:31, 27 September 2024 (UTC)
Reply
Alien333
Primarily, interwikis come from Wikidata. For this to work, the page needs to be connected to Wikidata (
Wikisource:WS Export
is, but for example
Wikisource:WS Export/de
isn’t).
Secondarily, interwikis can also be defined on the page itself, either directly or through templates like {{
Interwiki
}} (this is the “old way”, and the only way on multilingual Wikisource
until June 2021
).
Normally, the latter overwrites the former, but
multilingual Wikisource has a bug
resulting in both being displayed.
Tacsipacsi
talk
19:26, 27 September 2024 (UTC)
Reply
The site is down
edit
Latest comment:
1 year ago
1 comment
1 person in discussion
Hello! Awesome service! But the site is down now.
94.234.102.145
19:23, 12 November 2024 (UTC)
Reply
Site isn't working for English
edit
Latest comment:
3 months ago
1 comment
1 person in discussion
WS-Export is not working with English Wikisource. I have tested this using the EPUB download links for several texts (
[1]
[2]
[3]
) on several different browsers, both mobile (using iOS 7.4.1) and desktop (using Windows 10), and according to
[4]
other people have been seeing the same problem for almost a month now. On a mobile browser, the export site doesn't load at all; on a desktop browser it returns either a 503 Service Unavailable error message, or an Anubis bot-checking page which does nothing for about 20 seconds before giving a 503 error, or sometimes the message "This web service cannot be reached. Please contact a maintainer of this project." However, the site does seem to work for the Wikisource wikis in at least some languages other than English; in some cursory testing I saw it work for Polish
[5]
and Latin
[6]
but not Greek
[7]
. This problem has been noted on English Wikisource's main talk page (as linked above) around the beginning of this month, apparently without anyone noticing; I am reposting it here so that whoever is responsible for maintaining the site will know that this needs to be fixed. -
LaetusStudiis
talk
22:39, 29 December 2025 (UTC)
Reply
Retrieved from "
Wikisource talk
WS Export
Add topic