ISFDB:Community Portal


Jump to: navigation, search

ISFDB Noticeboards
Before posting to this page, consider whether one of the other noticeboards might suit your needs better.
Help desk
Questions about doing a specific task, or how to correct information when the solution is not immediately obvious.
Verification requests
Help with bibliographic, image credit, and other questions which require a physical check of the work in question.
Rules and standards
Discussions about the rules and standards, as well as questions about interpretation and application of those rules.
NewRules changelogArchives
Community Portal
General discussion about anything not covered by the more specialized noticeboards to the left.
Moderator noticeboard
Get the attention of moderators regarding submission questions.
NewArchivesCancel submission

Archive Quick Links
Archives of old discussions from the Community Portal.

1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · 28 · 29 · 30 · 31 · 32 · 33 · 34 · 35 · 36 · 37 · 38 · 39 · 40 · 41


Non-genre Shirley Jackson

Would it be all right to delete Shirley Jackson's non-genre stories? True, her supernatural fiction is very important, but it's only a small part of her work. Her summary page would have three times as much below the line as above if I simply marked things "non-genre". --Vasha 04:36, 29 December 2016 (UTC)

OK for me. Hauck 08:21, 29 December 2016 (UTC)
By the way, "After You, My Dear Alphonse" and "The Renegade" are in The Supernatural Index but this surely must be a mistake; you can read extensive summaries of them respectively here and here. Do Ashley & Contento ever make mistakes like that? --Vasha 19:06, 29 December 2016 (UTC)
Well, no bibliography is perfect, as Robert Reginald, an occasional ISFDB editor, used to say. I have been exchanging e-mail corrections with Bill Contento and Dave Langford (the SFE3 maintainer) for years. Ahasuerus 19:35, 29 December 2016 (UTC)
I'm inclined to think of her as well "above the threshold". (When L.W. Currey is selling three of her genre books for ≥ $1,000, that kind of demonstrates her importance.) One of the things about the non-genre listings is that it tells genre collectors of an author which books to *not* bother getting, and for the important authors, that's really useful information. Chavey 17:12, 30 December 2016 (UTC)
I was also thinking that it would be kind of nice to have the non-genre work listed for reasons similar to what Darrah said -- so people could look at a story and see definitely that it was non-genre, rather than wondering if we just hadn't listed it yet. The problem is that if you apply that logic to all authors who have a lot of non-genre work, you start listing everything ever. The whole concept of a threshold was to prevent that. Is one of the nebulous criteria for this line that the author is important? Even if they‘re not about 50% genre? I have made a rough survey of Shirley Jackson's fiction, and came up with about 42 short stories and 4 novels in the genre, about 120 stories and 2 novels out of it. That's 35% or so. --Vasha 19:04, 30 December 2016 (UTC)
Someone correct me if I'm wrong, but I believe for non-genre works of "above the threshold" authors, we do include book-length works (i.e., non-fiction books, novels, collections, and, I suppose, possibly chapbooks), but not short works contained in other publications. --MartyD 11:30, 5 January 2017 (UTC)
I agree. Hauck 09:05, 6 January 2017 (UTC)
To quote the Rules of Acquisition, "This includes any non-genre works published as standalone books as well as non-genre short fiction...". The policy specifically allows non-genre short fiction. I think it comes down to what do you mean by "other publications". If you mean a non-genre magazine or a non-genre anthology, then I would agree as those publications don't belong. However, if it's collection of an above-the-threshold genre author, than the non-genre short fiction should be included as well per our policy. Given your question is under this topic, I assume it was based on the edit by Vasha77 that you have on hold? If so, than if it's agreed that Shirley Jackson is above the threshold, that edit is valid per our current inclusion policy. -- JLaTondre (talk) 15:35, 7 January 2017 (UTC)
Makes sense. That was the submission, and I have accepted it. Thanks for the feedback. --MartyD 11:56, 9 January 2017 (UTC)

Zac Brewer

Zac Brewer has changed his name since coming out as trans. He has many publications as Heather Brewer, only a few as Zac. But not only is he no longer using the name Heather, but he has also changed online references to him as much he could, and set up all-new websites under the new name. Therefore, I think we should make Zac Brewer the primary name and Heather the pseudonym. What do you say? --Vasha 23:17, 29 December 2016 (UTC)

It's a fairly common scenario: an author becomes known as A, then changes his or her primary working name to B for some reason. In most cases it has to do with marketing, but we also have a number of authors who changed their working names after a gender change, e.g. Hank Stine/Jean Marie Stine or Amos Salmonson/Jessica Amanda Salmonson.
As per Help, "For authors who publish under multiple names, the canonical name is the most recognized name for that author". Swapping VTs is somewhat time-consuming, so in most cases we wait until the new name acquires a critical mass of titles. Then again, sometimes old, abandoned names linger for years because no one is willing to spend the time necessary to rearrange everything, e.g. see Megan Lindholm who has been better known as "Robin Hobb" for the last 20 years. In the grand scheme of things it's not too important as long as all titles appear on the same Summary page. Ahasuerus 00:26, 30 December 2016 (UTC)
Actually, I think it is important to recognize the new identity when someone has come out as trans. And it really wouldn't take very much work just to variant all the HB books to ZB. Plus, we hope he has a long career; so it will be much harder to do this change in the future! --Vasha 00:34, 30 December 2016 (UTC)
Well, our "canonical name" values are not judgements re: SF authors' identity. Similarly, our "working language" values are not judgements re: SF authors' primary culture. We don't get paid enough to tackle such weighty issues :-) We just record author names as they appear in books and magazines and then pick the most recognizable name as the canonical value. It's similar to the way we determine canonical titles -- "the canonical title is usually the first title for that work, but may be a later title if that title is much better known". Ahasuerus 00:57, 30 December 2016 (UTC)
It is true that currently, someone is likely to pick up a book with "Heather Brewer" on the cover and consult the database to find out what else this author has written. What's the harm, though, if the answer they get is "this author also uses the name Zac Brewer, consult that page for other works"? At some point, presumably, the name Zac will become recognizable, though he just announced the change a few months ago. I just don't see the point of waiting some nebulous length of time... is it recognizable in two years, three, what? Might as well make the change now -- it's not like the page for Heather will be deleted entirely. --Vasha 01:08, 30 December 2016 (UTC)
If you feel strongly about it, you can always reverse the direction of the pseudonym and the variants. :) Bibliographies tend to be just that -- records of existing records. Annie 01:16, 30 December 2016 (UTC)
That is so -- and the Heather Brewer records will still exist, if we variant them to Zac Brewer (as we should). --Vasha 01:25, 30 December 2016 (UTC)
My only concern with making the change now -- rather than waiting until there is a critical mass of "Zac Brewer" books -- is that it assumes that there *will* be more "Zac Brewer" (SF) books. What if the author switches to mysteries or stops writing altogether? At some point we'd have to decide that it's been "long enough" and go back and change the VT/pseudonym direction again. It's not a huge deal either way, but it seems safer to wait. Ahasuerus 01:27, 30 December 2016 (UTC)
Z. Brewer has currently one short story and one novel, but has announced two more novels coming out next year (both speculative). --Vasha 01:40, 30 December 2016 (UTC)
It's encouraging that they will be speculative -- the fact that the only novel that has been published as by Zac Brewer so far contained no known speculative elements had me a bit nervous. Barring another industry meltdown like the one we had in 2008-2009, we should be most likely safe making the proposed change. Ahasuerus 02:05, 30 December 2016 (UTC)
OK, how about waiting until one of those books actually appears, then? --Vasha 04:06, 30 December 2016 (UTC)
Sounds like a plan! Ahasuerus 04:10, 30 December 2016 (UTC)

(unindent) I also think that sounds like a good idea. We don't always follow the preferences of an author, such as those that have been asked to be removed, or to have a particular item removed, or those who've asked to have birthdays removed (when they are public data). Gendered names are a bit different though, and I think we should normally follow an author's preference when it comes to such a name. But I think it's also appropriate to wait until that name has "announced" to the SF community, e.g. through a genre book with their new name. For example, Amos Salmonson was *living* as Jessica for about a year before making a formal announcement of her change -- which happened in "Mom's Home Made Apple Fanzine" in 1974 when she published a particularly feminine picture of the person that "Amos" had become. Most such announcements aren't quite as easy to pin down to a particular date, but publishing two genre books under his new name would certainly do that. Chavey 17:27, 30 December 2016 (UTC)

I think the biggest problem with following the author's preferences in a certain subset of cases is that there are other, equally compelling, subsets of cases. For example, take an author who has gone through a very painful divorce and wants to have as little to do with her old married name as possible. Or take an author who has been forced to use a pseudonym because the books published under the original name didn't sell well and whose resurrected career is still hanging in the balance. She may well see anything that promotes the pseudonym as helping her career to survive and vice versa.
It's all understandable and justifiable, but if we start making exceptions for "worthy causes", it will be very hard to preserve any kind of objective standard. Ahasuerus 18:22, 31 December 2016 (UTC)
I would go so far as to say the ISFDB "cause" is a "worthy" one and thought we might recognize others and attempt to not ignore such, for our project our standards must come first. For the reasons mentioned above, the most common name is still the older one (until a large body of in-genre work changes that). Uzume 03:21, 6 January 2017 (UTC)

Improving our support for diacritics in author names

As per this discussion, our software considers character pairs like "Ó"/"O", "í"/"i" and "é"/"e" identical. For this reason the fact that we have a "Salvador Dali" author record on file means that we can't have a "Salvador Dalí" author record -- the software thinks that they are the same name and duplicate names are not allowed. Note that this only applies to non-English West European characters. Other similar characters are not affected, which is why we have a record for "Stanislaw Lem" as well as a record for "Stanisław Lem".

The current software behavior is inconsistent and frequently forces us to use compromises and workarounds when dealing with diacritics in author names. It's been suggested that we change the software to allow both "Salvador Dali" and "Salvador Dalí" at the same time. (The plan is to keep the lookup algorithm case-insensitive so that when an editor submits "robert a. heinlein", the software will realize that we already have "Robert A. Heinlein" on file and use that record instead of creating a new one for "robert a. heinlein".)

I have run a few experiments and tweaked some parts of the software on the development server. At this point I am 90% sure that we can change the code to support both "Salvador Dalí" and "Salvador Dali". A search on either "Salvador Dalí" or "Salvador Dali" will find both author records. It won't be a trivial change and it will require careful testing, but I think it's doable.

The only downside that I have found so far is that there will be a slight overhead when displaying submissions containing many authors. The current algorithm hardly takes any time at all to look up an author record when displaying a submission. With the new way of doing things it will take something like 0.04 second per author, which will mean 1+ second delays when displaying a submission with 30+ authors. Luckily, it doesn't happen very often and the trade-off appears to be worth it.

If there are no objections, I will start working on the proposed change once I finish processing the latest round of Fixer submissions. Ahasuerus 22:23, 30 December 2016 (UTC)

That will be a nightmare in terms of pseudonyms. Let's take this diacritically-challenged author. He's usually given as "Hervé" (even in the vast anglo-saxon world like here) but, sometimes he's been changed to "Herve" (like here). If I understand it correctly, the proposed change would mean that we'll have two authors (Hervé and Herve) that will have to be pseudonymistically linked with the correct varianting done. Hervé (or is it Herve) Hauck 19:15, 31 December 2016 (UTC)
That's right. It will be similar to the way Stanisław Lem's Summary page currently looks: Polish titles use "Stanisław" while translations use a mix of "Stanisław", "Stanislaw", "Stanislas" and " Stanislav" depending on the publisher's/translator's whim. Ahasuerus 20:11, 31 December 2016 (UTC)
Imagine the work and the look of the author's page (note that I'm already quite displeased by such pseudonyms settings (Liu Cixin being a pseudonym of Cixin Liu). Hervé (or is it Herve) Hauck 19:15, 31 December 2016 (UTC)
The "Liu Cixin"/"Cixin Liu" situation is temporary. The canonical name will be soon changed to "刘慈欣" and the two Romanized forms of the name will become pseudonyms. Ahasuerus 20:06, 31 December 2016 (UTC)
I'm completely against this move.Hervé (or is it Herve) Hauck 19:15, 31 December 2016 (UTC)
Another thing to consider is that some authors have nearly-identical names, the only difference being an accented character. A while back we ran into a couple of Dutch (?) authors whose names were something like "Peter Frai" and "Peter Fraï" (I don't recall the details), which we had to disambiguate with a "(I)". Ahasuerus 20:26, 31 December 2016 (UTC)
As a general observation, one of the long-term goals of this project has been to get as close to the "exactly as stated" standard as possible. We have found that everything works much better when we capture things as they appear in publications and handle the rest using variants/pseudonyms/etc. It's not always feasible, e.g. we wouldn't want to create a pseudonym/variant for all-lowercase and all-uppercase forms of author names/titles, but it has been the general direction of the project. Ahasuerus 20:34, 31 December 2016 (UTC)
To keep on this general level, that goal is commendable but, as I wrote before, I was at first strongly convinced by this approach, but very quickly I was confronted to such concepts as "case regularizations", "publisher regularizations", "initial regularizations", "space regularizations", "Ranks, suffixes, prefixes regularizations", "ellipsis regularizations" (to name a few, with some that appear here) that are not really conform to our "exactly as stated" professed standard. I was even called to order for entering a title as it was ("It's a typo" was the answer). That's why I frankly doubt that "exactly as stated" IS in reality the general direction of the project. The real debate to have is in fact to decide which of our idiosyncrasies we keep. Hauck 10:47, 1 January 2017 (UTC)
It's certainly true that we have added many caveats to the "exactly as stated" standard over the years. Some of them were due to software limitations. For example, the software supported only one publisher per publication, so we needed to have special data entry rules for publications associated with multiple publishers (like various book club reprints.) Similarly, there was no separate field for imprints, so we needed to have rules for squeezing imprints and publishers in the same field. The list goes on.
In addition, we wanted to avoid data fragmentation, which is also related to software limitations. Since there is no "variant publisher" mechanism, entering publisher names exactly as they appear on title (copyright?) pages would have created a lot of "publisher names" per actual publisher, making it hard to see what the publisher has actually published. Hence the "publisher regularization" rules.
Finally, some regularization rules were created (and sometimes enforced in the software) in order to facilitate searching and other types of user experience. The "ellipsis regularization" rules were among them.
Having said that, I should also point out that we have been slowly enhancing our software to allow closer compliance with the "exactly as stated" standard without adversely affecting user experience. For example, take the process of adding "transliterated titles/names" in 2015-2016. Users who don't know Kanji/Cyrillic/etc can still search on transliterated titles/names and see them in mouse-over bubbles while the primary data is now entered "exactly as stated", i.e. using the original script/alphabet.
It's a slow process, but if we continue pushing the software in that direction, we should be able to eliminate more and more "regularization" rules over time. Ahasuerus 22:36, 1 January 2017 (UTC)
I like the idea of having the author name as is but I do agree that the author pages are getting crazy. Maybe we need another user preference that hides all those "as by" from the author summary page. Incidentally Annie 11:46, 1 January 2017 (UTC)
Let me make sure that I understand the proposal correctly. Would this user preference suppress the display of "as by Pavel Vejinov", "as by Pavel Vešinov" and "as by Pawel Weshinow" on Павел Вежинов's Summary page but keep the translated titles intact? What about Robert A. Heinlein's Summary page? Would it make the line which currently reads "Life-Line (1939) [as by Robert Heinlein]" disappear since the canonical title is "Life-Line", i. e. the same as the variant? Ahasuerus 22:02, 1 January 2017 (UTC)
Yes for the Вежинов - all non-Latin-1 authors pages look overloaded now because of the too many English/German/French/Dutch titles we have. And we add more Russian/Bulgarian/Japanese titles, the Latin-1 ones will get in that direction (which is what Herve is also talking about I think). Annie 22:39, 1 January 2017 (UTC)
If the issue is that author pages can become too busy due to translations, wouldn't the user's response be to go to User Preferences and either turn off all translations or select a subset of languages that he or she is interested in? Ahasuerus 23:13, 1 January 2017 (UTC)
But I want to see all the translations - I just do not want to see whatever pseudonym was used for the specific variant. Annie 23:42, 1 January 2017 (UTC)
Plus if you only leave English and German for example on Lem's page (or any non-Latin language one), every single line will have "as by". Which makes the page really crowded. Same if I leave only Russian and Bulgarian on a Latin-1. Annie 23:57, 1 January 2017 (UTC)
Well, it depends on the number of translations. Коста Сивов, a Bulgarian author, hasn't been translated -- as far as we can tell -- so his page looks pristine. On the other hand, someone like Lem will have a lot of "as by"s. I have never thought of it as an issue, but I guess suppressing the "as by" component would make the page easier to read. I don't think it should be hard to implement -- please go ahead and create an FR. Ahasuerus 01:17, 2 January 2017 (UTC)
Right, I need to go figure out what my account used to be there :) Annie 01:54, 2 January 2017 (UTC)
Shouldn't be a problem -- our SourceForge settings let anonymous users create FRs and Bug reports. Ahasuerus 01:57, 2 January 2017 (UTC)
Ah, did not realize that. Thanks! :) Annie 02:00, 2 January 2017 (UTC)
One more note - people coming to the DB for the first time (no account, so no preferences) - they do not have languages filtered. And the page just looks... very busy. If I see that, chances are, I will go and look elsewhere for a list of Lem's works for example... This problem had gotten worse since we added the language support for authors. Annie 01:54, 2 January 2017 (UTC)
Users who are not logged in see the following message on Summary and Series pages:
  • Showing all/no translations. [Cookies-based button which lets them turn translations on and off] Registered users can choose which translations are shown.
One click of a button and all translations go "poof"! Ahasuerus 02:00, 2 January 2017 (UTC)
Again - the problem are not the translations but the "as by" on every single line in some cases. Annie 18:07, 4 January 2017 (UTC)
I guess we could add another cookies-based button to let unregistered users eliminate all "as by"'s, but I think that level of customization really ought to be handled via User Preferences. Ahasuerus 18:48, 4 January 2017 (UTC)
I am not sure for the Heinlein case - if the title, language and year are the same, we can as well not show it (we have the variant because of the name change). However - if it has titles under both variants, we need a way to filter under the other variant only so I suspect we need to have it there. Or have a "show all variants" link. Annie 22:39, 1 January 2017 (UTC)
- I would also love to be able to see a list of works under a pseudonym without the need to go for "show all works". Annie 11:46, 1 January 2017 (UTC)
Could you please clarify? Each pseudonym should have a "or view all titles by this pseudonym" link on the "See: [canonical name]" line. Are you seeing something else? Ahasuerus 21:55, 1 January 2017 (UTC)
They are there but in the merging/searching format as opposed to just a list (as on the main author page). So I cannot find out a glance which books from a series are available under the pseudonym (and for some languages this will mean under the language) Annie 22:39, 1 January 2017 (UTC)
Ah, I see. I think I looked into this issue a while back but gave up due to various complexities associated with creating a "pseudonym-only" bibliography page. I am sure it's possible given enough man-hours. If you find this functionality useful, please go ahead and create an FR. Ahasuerus 23:08, 1 January 2017 (UTC)

(unident)I think this will be good in the long run. In the short term, it will be a pain as everything is adjusted to meet the updated standard, but supporting Unicode (I'm assuming that's what's being changed, since it would allow for the differences in letters) is the way things should go. I'm not bothered by the pseudonym listings on author pages. ···日本穣 · 投稿 · Talk to Nihonjoe 17:35, 1 January 2017 (UTC)

Actually, the proposed change can be implemented without converting to Unicode. The database and the software are not quite ready for the conversion at this time, although it *is* on the list for a number of reason. For example, it will improve searches which include non-Latin characters. The way things work now, a search on "Асен" finds Асен Милчев, but a search on "асен" doesn't because the software has no way of telling that the Cyrillic "A" should be treated the same as the Cyrillic "а" for search purposes. Ahasuerus 21:50, 1 January 2017 (UTC)
I look forward to that day. There is a similar problem in searching for items in Japanese via kana aliases. As I understand it the only way around this currently is to search for all strings and/or create many transliterations. Uzume 11:24, 4 January 2017 (UTC)
Did you mean romaji instead of kana?--Rkihara 16:51, 4 January 2017 (UTC)
No, I mean kana. Though kana is used directly in Japanese so is kanji and even natives do not always know how to pronounce such depending on context, etc. Thus, kana is used as a means for a pronunciation guide and for indexing. As such, it is thus a form of transliteration. Romanji is just a set of Latin-based transliterations of Japanese. I am sure Russian speakers would appreciate Cyrillic transliterations of Japanese names and titles too (e.g., see wikipedia:Cyrillization of Japanese). To get back on topic, I just meant to search via kana one needs transliterations for such. Uzume 15:18, 5 January 2017 (UTC)

Disappearing cleanup reports

The number of cleanup reports dropped significantly in the last few hours. For example, Japanese Titles with a Latin Author Name, which had over thirty items on it (including several for which I could find no Japanese) earlier today, is no longer there. Did something happen to all the cleanup reports? ···日本穣 · 投稿 · Talk to Nihonjoe 06:20, 2 January 2017 (UTC) they all seem to be back. Maybe I caught it when it was updating all of them? ···日本穣 · 投稿 · Talk to Nihonjoe 06:21, 2 January 2017 (UTC)
Yup. Regeneration time starts at 1 am eastern US time and finishes about 30-40 minutes later. Annie 06:28, 2 January 2017 (UTC)
Been there—done that. It is disturbing looking at and whittling down the list to see it suddenly empty and then refill but apparently that is our reality. Uzume 03:24, 4 January 2017 (UTC)
Yes, that's how the cleanup system was designed to work. However, there is nothing preventing us from improving it if we can come up with a better approach! :) Ahasuerus 04:30, 4 January 2017 (UTC)
I would have to look into how the report results are implemented and stored but we could have it so new results overwrite the old results only upon completion, thereby never leaving a period of time when there are no results available (and thus removing the experienced disconnect). Uzume 11:18, 4 January 2017 (UTC)
They are missing for 30 minutes at the most (for the last reports). I suspect that there are a lot of other places where developer time will be better spent... And as someone that works on these a lot - I prefer them disappearing and then showing up slowly than having the old one (and working off it) and having it all replaced in a second on me. This way I know when to back off and wait for the new ones and do not end up with a "so what had I gone through now" when new values get added. But it may be just me. :) Annie 20:09, 4 January 2017 (UTC)

Preface to Mary Shelley's "Frankenstein"

The preface to Mary Shelley's "Frankenstein" ends with the "signature": "Marlow, September 1817". This has been incorrectly interpreted in several of our records (11 publications) as if the name "Marlow" were a pseudonym for the true author, who is otherwise unstated (although usually believed to be Percy Shelley). In fact, the Shelleys had moved to the town of "Marlow" in March 1817, where they lived until March 1818, and this "sign off" is simply a statement of where and when the preface was written (as happens with many other similar essays). I have put some additional detail in the Percy Shelley preface record. Unless there is objection, I would like to change this title and this title from an authorship of "Percy Bysshe Shelley (as by Marlow)" to an authorship of "Percy Bysshe Shelley (as by uncredited)". This affects verifications by me, MLB, Chronsf, Gzuckier, Syzygy, Mhhutchins, Don Erikson, and Bluesman (3 times). Chavey 05:20, 3 January 2017 (UTC)

That sounds like the right move to me. Good find. Uzume 03:27, 4 January 2017 (UTC)
Completed. Chavey 13:30, 7 January 2017 (UTC)

Container Titles without a Language - 2017-01-03 update

We are down to 82 Omnibus titles without a language. I believe all of them are English titles.

I have modified the report to include collections. The updated data will be available tomorrow morning. There are about 2,000 language-challenged collections, almost all of them English. My cursory review found only one non-English collection by Harlan Ellison, but there may be a few more. If a volunteer editor(s) could review the list looking for other non-English collections, it would be great. Once we are confident that only English collections remain outstanding, I will set all language-deficient omnibuses and collections to English programmatically. Anthologies will be next. Ahasuerus 02:48, 4 January 2017 (UTC)

I wonder if all the various reports are really still necessary after things have stabilized (which might not yet be applicable here but certainly should be for some older things). As an example, eventually could this "report" not just degrade to a pre-canned search link? Uzume 03:30, 4 January 2017 (UTC)
If it is empty, it will not show up. Annie 03:43, 4 January 2017 (UTC)
That's right. You can also access our full list of cleanup reports, although I don't recall if non-moderators can see all 195 of them. Which reminds me that I need to make more of them available to non-moderators. Ahasuerus 04:29, 4 January 2017 (UTC)
Being run will catch any new titles that somehow end up in that situation - and having them nightly means that noone needs to remember to check the pre-canned link... Just thinking aloud Annie 03:43, 4 January 2017 (UTC)
True. Unfortunately, some reports lock certain sections of the database which means that the server appears to be unresponsive while they are running. It would be beneficial to take a closer look at the timings and determine if we can improve certain things. Ahasuerus 04:29, 4 January 2017 (UTC)
Make some of them weekly or monthly once they are down to one or 2 entries every few days/weeks? Annie 04:33, 4 January 2017 (UTC)
Sounds like a good idea! Ahasuerus 04:44, 4 January 2017 (UTC)
I can look through all the omnibuses, chapbooks and collections this evening and clear the non-English ones out so that everything else can get assigned automatically. Annie 18:17, 4 January 2017 (UTC)
All OMNIBUS editions in the language challenged report over here are English and can be set automatically. Collections check - tonight. Annie 18:46, 4 January 2017 (UTC)
Or during lunch. 2 non-English found and already updated; everything else is in the clear and can be set to English. Annie 19:28, 4 January 2017 (UTC)
Great, thanks! Ahasuerus 19:32, 4 January 2017 (UTC)
Without the 4 I had open and never submitted that is - done now. :) Will do one more visual pass just in case but we are good to go. Annie 19:34, 4 January 2017 (UTC)

Show printing on title list page

A proposal for the list of works on a page. Look at this page. The verified edition is 4th printing. When I look at the page, I see two entries with the same price and the same ISBN and publisher (or more than 2 for the some more popular works). The only way to find out if I need to clone or can verify one of the existing ones will be to open each one to see if my printing is there by any chance... Any way to add "printing" somewhere more visible on the list? Annie 18:16, 4 January 2017 (UTC)

It sounds like the functionality requested in FR 794. I don't think there were any objections when it was proposed. Ahasuerus 18:51, 4 January 2017 (UTC)
Yes, did not find it when I looked. Annie 19:10, 4 January 2017 (UTC)

Server downtime 2017-01-04 @8pm

The server will be brought down for automated language assignment at 8pm server time. Estimated downtime less than 5 minutes. Ahasuerus 00:38, 5 January 2017 (UTC)

The server is back up. Over 12,000 titles have had a language code auto-assigned. Next I will update the cleanup report to include anthologies and chapbooks. Ahasuerus 01:06, 5 January 2017 (UTC)
Yey! We are getting there :) Annie 01:15, 5 January 2017 (UTC)
Indeed! The cleanup report has been updated and the results will become available tomorrow morning. I expect that it will find a bit over 1,000 anthologies and around 1,000 chapbooks. Ahasuerus 02:00, 5 January 2017 (UTC)
All remaining OMNIBUS editions on the list are English. I'll clear the non-English CHAPBOOks next (probably over the weekend). Ready to list languageless EDITOR records after that? :) Annie 18:27, 6 January 2017 (UTC)
I thought the omnibuses were taken care of in the last patch. Did you, by chance, mean anthologies? Ahasuerus 21:21, 6 January 2017 (UTC)
*sigh* I do need more coffee apparently. Anthologies - yes. All 903 of them. Sorry. Annie 21:23, 6 January 2017 (UTC)
No worries and thanks for working on them! I will update and re-run the script later tonight. Ahasuerus 21:53, 6 January 2017 (UTC)
They are a good distraction when I get tired of making Finnish and Italian variants and fixing weird language assignments for the multi-language report :) Annie 22:51, 6 January 2017 (UTC)
Chapbooks are all clear for automatic English assignment. A few suspicious ones were verified to be English indeed and a couple got their language assigned differently. Annie 18:07, 8 January 2017 (UTC)
Thanks, I will take care of them in another hour or two. Ahasuerus 00:10, 9 January 2017 (UTC)
Would you also update the report to pull EDITOR records with no language? That should get a lot of short stories taken care of when they are cleared. Annie 00:42, 9 January 2017 (UTC)
That's right. The first patch will take care of chapbooks. The second one, which I expect will be installed around 9pm, will add EDITOR titles. I need to re-run nightly processing on the development server first, which takes a while. Ahasuerus 00:52, 9 January 2017 (UTC)
Done. Ahasuerus 01:47, 9 January 2017 (UTC)
All EDITOR records are English. So they need some languages assignment :) Annie 07:31, 9 January 2017 (UTC)
Thanks! I have started a new section to discuss the rest of the title types. Ahasuerus 16:14, 9 January 2017 (UTC)

Common name

What should be the common name (and main pseudonym) for this guy: here. Born in what was the Russian Empire, technically Lithuanian and lived in the USA for the last 20 years or so of his life. Do we use his Russian name or his Lithuanian name or his English name as his main name (and as his legal name come to think of it)... PS: Here he is Annie 00:00, 6 January 2017 (UTC)

We typically use the most common in-genre name, e.g. "Vladimir Nabokov" rather than "Владимир Набоков". In this case the challenge is that the spelling used by the Italian publisher responsible for his only known genre credit is unorthodox: "Mistislav Dobuzhinsky" instead of "Mstislav Dobužinskij" (Italian) or "Mstislav Dobuzhinsky" (English). I would suggest using "Mstislav Dobuzhinsky" as his canonical name and creating a VT/pseudonym. That way anyone looking for "Mstislav Dobuzhinsky" will be able to find him. Ahasuerus 00:53, 6 January 2017 (UTC)
Yeah, this is why I asked - because of that weird spelling - if his first name was properly spelled, I would have left it alone and left it as is. That sounds like a good plan. :) Thanks! Annie 01:43, 6 January 2017 (UTC)

Server downtime - 2017-01-06 @8pm

The server will be brought down at 8pm server time for another language assignment iteration. Ahasuerus 00:08, 7 January 2017 (UTC)

The server is back up after 4,000+ auto-assignments. Ahasuerus 01:05, 7 January 2017 (UTC)

Queue for Changes to Verified Pubs?

There’s a lot of variation in what changes a Primary Verifier will allow to pass without notification. Because of this, I’ve been thinking that it might be a good idea for changes to verified pubs to be automatically put in a special queue for a short period, maybe 2-3 days to allow the top level, active Primary Verifier of the pub to put a hold or pass on the changes. If there are no active verifiers or holds, then the pub passes to the submission queue. Changes by Primary Verifiers to their verified pubs go straight to submissions.—Rkihara 17:31, 7 January 2017 (UTC)

A few questions to make sure that I under the proposed functionality:
  • How will the pub's primary verifiers be notified about the proposed change? (I assume that all of them will need to be notified since there is no way of telling who is active)
  • Will only one of the primary verifiers be able to put a submission on hold?
  • Will moderators have the ability to approve these types of submissions regardless of their status?
Ahasuerus 15:54, 8 January 2017 (UTC)
  • I thought that a pass/hold option could be added to the new verifier notification feature.
  • If there's no way of telling who's active any primary verifier will do.
  • The verifier placing the hold would have to clear it for it to enter the submission queue, where it is subject to moderator approval.
  • I'm now thinking the window to hold a verified pub should be no longer than 24 hours to keep things from backing up.--Rkihara 17:58, 8 January 2017 (UTC)
Verifier notification pages are updated when a submission is approved. What you are proposing is a mechanism that would prevent submissions from being approved -- for at least 24 hours -- if the affected pub has at least one primary verification associated with it.
I think the biggest problem that we have with changes to verified pubs is that there is no way of telling what the data looked like prior to the change. If there was, then a primary verifier could easily go back, check what was changed and revert the changes if needed.
Unfortunately, a "history" system would be difficult to implement. Simple fields like "price" and "ISBN" would be easy. Contents items would be the hardest part. Not only can a submission add or edit titles, but it's possible for some of the affected titles and authors not to be in the database at some future point. A history system would have to capture a snapshot of each publication record before and after the change. That's a lot of work. Ahasuerus 00:27, 9 January 2017 (UTC)
Could a manual summary of the changes made to a verified pub be made mandatory by blocking submission to the approval queue unless something is entered into a change history field? We're already leaving notes on the primary verifier's discussion page.--Rkihara 17:07, 9 January 2017 (UTC)
Just for the record, note that in your updates to Astounding/Analog you're leaving notes on the pages of clearly inactive verifiers (Hall3730‎, Davecat, Alibrarian, Boxen) and not on those of the "active" verifiers, which is, IMHO, not very useful. Hauck 17:32, 9 January 2017 (UTC)
That's true, I'm in the habit of leaving notes with Primary 1, since there were no other primaries when I started. That's why having a mandatory change field associated with the pub would be better. It doesn't matter who's active.
For the record, I originally filled in the missing data for lot of these magazines without checking off as the verifier, then worked with Swfritter double check his verifications. Now that I'm going through again, I'm taking a primary verifier slot if open. That makes me an active verifier, and I also recheck the contents.--Rkihara 18:08, 9 January 2017 (UTC)

(unindent) So basically make the "Moderator Note" field mandatory in the "Edit Publication" form if the publication has been primary-verified? And then make sure that the value of the Moderator Note field is displayed when the primary verifier views the submission that modified his or her verified pub? If so, then yes, it's doable and relatively easy to implement. Ahasuerus 18:35, 9 January 2017 (UTC)

I was thinking of a permanent change history field, along the lines of the bibliographic field. This would allow anyone to see what modifications have been made to a pub over time.--Rkihara 18:53, 9 January 2017 (UTC)
Oh, a new "change history" field in publication records? And make it mandatory to add something to it when editing a primary-verified publication? Ahasuerus 18:58, 9 January 2017 (UTC)
Yes, that's what I was thinking of. That way there's no time limit to review changes and they're all in one place, rather than scattered across the discussion pages of the primary verifiers. I suppose there could be problems with merges?--Rkihara 19:42, 9 January 2017 (UTC)
Unlike titles, publications can't be merged, so that shouldn't be an issue.
My tentative take on this issue is that it should be doable. We will have to add a "Change Summary" field to Edit Pub and then to Import/Export and Remove Title. The field will be required for primary-verified pubs and optional for all other pubs. It will be maintained as a change log, with each change record capturing the following information: publication ID, submission ID, editor ID, editor-entered change summary. Publications will have a "View Change History" link which will take the user to a new Web page displaying this information as a list or a table.
This approach will allow editors to explain not only the "what" of each change, but also the "why". Currently this information is either not entered at all or entered in the "Moderator Note" field, which is transient. Of course, the approving moderator will need to make sure that the explanation makes sense, but that's to be expected. Overall I like it. Ahasuerus 00:26, 10 January 2017 (UTC)
I'm against this move. Adding another mandatory field is, IMHO, 1) useless as the moderating process and the obtaining (is this word english?) of pertinent information seems a quite streamlined process for the moderators that actually moderate the bulk of the submissions, 2) superfluous as the principles of notification are quite clear and just need to be collectively enforced, 3) counterproductive as this will raise another barrier to the entrance of new contributors, the entering of data is complex enough that we should aim for simplicity and ease. Hauck 08:04, 10 January 2017 (UTC)
(I would use "the obtaining".) A half-baked, pre-coffee thought: How about a slightly different approach? If there were a way to "publish" a submission to the primary verifier(s) -- prior to acceptance -- and those verifiers had a way to look at the submission and either to indicate approval/disproval or simply comment on it, that might streamline a lot of communication (and research) for moderators and for editors. The submission could also have something to indicate it is so published. Original submission could make this an additional option (i.e., a submit + publish) -- perhaps a checkbox toggled on by default for anything with primary verifiers? And the moderator review screen could also provide a way to do it. Notification to the verifiers could use that same new change notification mechanism. --MartyD 12:46, 10 January 2017 (UTC)
One other negative aspect will be a general slowing down of the approval process, either creating possible edit conflicts or simply discouraging potential contributors. To be frank, I don't really see what is the problem with the present moderation and notification process (it seems to work OK, without mishaps and with a correct communication level) but perhaps am I to immerged in it to see it from outside. Hauck 13:15, 10 January 2017 (UTC)
Looking at the first line, the original problem was the variety of things that verifiers allowed to pass without notice. The new schemes seem to be treating all changes as the same for all verifiers, leaving the onus on them to filter. The desire to avoid stalling the system means that verifiers who log on every few days will be bypassed anyway. Another sideways look at this is to add flags of various sorts for verifiers (e.g. images) and the active indicator, which would be displayed with the list of verifiers so an editor knows who to notify? Doug H 14:35, 10 January 2017 (UTC)
The edit conflicts are already bad enough - that will multiply them badly. And the software is challenging enough when you start to add this to the nightmare. I understand people wanting to protect their data and so on but this is a shared platform. Can a snapshot of all OLD values be dropped into a column somewhere so the verifier(s) can go and explore changes if need be? I almost gave up the first few days (despite moderators being around and fairly active). Annie 15:49, 10 January 2017 (UTC)
The proposed change only ensures that you log your changes, which you are already supposed to do on the verifier's page anyway. This puts "all" of the change history in one place instead of scattering it across the pages of maybe five verifiers. How hard is it to do what you're already required to do?--Rkihara 17:26, 10 January 2017 (UTC)
When you change many records where I'm PV2 and where the PV1 is inactive and do not notify me, I'm not sure that's what is required. But it's probably peripherical.Hauck 18:17, 10 January 2017 (UTC)
More than one primary verifier is a recent change, so most change notices will be found in Primary 1. I put them in PV1 for that reason, one-stop checking, instead having to look in PV1-5. Since the system flags you that I have made a change, a look in PV1 will find the note. There is no hierarchy in verification, and if there should be it seems that the "last" PV is the one that should notified if there is a change-as they've had the most recent look at the pub.--Rkihara 19:51, 10 January 2017 (UTC)
If you think that you're allowed to ignore our standard (and stated visibly on every unactive verifier's page) procedure "Otherwise, please post notices and inquiries only on the talk pages of the other primary verifiers." because you don't feel so, it's useless for you to talk about (I cite you) to do what you're already required to do.Hauck 08:49, 11 January 2017 (UTC)
Okay, since I'm making myself a primary verifier, if not already, I'll post it on my page.--Rkihara 09:00, 11 January 2017 (UTC)
People were talking about holding submissions for PVs to review - that is what I had been commenting about. Notifications of any type are not a problem of course Annie 17:55, 10 January 2017 (UTC)
The idea of holding the submission was abandoned and the discussion has moved down another path.--Rkihara 18:10, 10 January 2017 (UTC)

(unindent) Re: "a snapshot of all OLD values". Unfortunately, it would require a significant effort. Granted, it would be easy to do for fields like "ISBN" and "Price". However, consider publishers. The way the database works, we store publisher numbers (1, 2, 3, etc) in publication records. Then, when we display a publication, we retrieve the name of the publisher, including its transliterated name(s), from other parts of the database and display them.

This works well when displaying current data. However, suppose we were to save a verified publication record as it existed prior to submission approval. We would store publisher ID 12345 in the saved record. Then, a few months later, publishers 12345 and 12346 are merged, so publisher 12345 no longer exists in the database. When the original verifier goes back to check this pub's history, there is no publisher 12345 to display. The same thing can happen to publication series, authors and titles. Actually, it can get even more complicated with authors and titles if we want to preserve the pseudonymous/VT/series relationships as they existed at the time.

The ultimate way to address this issue would be to build a snapshot of the then-current version of each about-to-be-changed Publication Web page and store it in a separate database location prior to submission approval. We could then have a list of snapshots for every publication and display them on demand.

Actually, checking the code, I see that it would be doable, although disk space may be a concern. Let's see. We have 784,600 Edit Pub submissions. Since 27.5% of our pubs have been verified, let's assume that 30% of Edit Pub submissions affected verified pubs. That's 235,000 submissions. Assuming 7Kb per verified publication (a mix of novels, collections, magazines and anthologies), that's 1.6Gb over a 10-year period. That's not really too bad and won't affect our disk space situation too much, at least not in the foreseeable future. So maybe it's doable after all. Ahasuerus 17:27, 10 January 2017 (UTC)

Maybe as a first step, not a full snapshot that has full links in all directions but just a snapshot of the submission as it shows on the left side (or just the red lines if possible). It won't contain changes in something done directly on publishers and internal titles but at least will have a story of what was in the field and will be better than it is now. Annie 17:35, 10 January 2017 (UTC)
I expect that a full HTML snapshot should be easier to implement than a partial snapshot. We started work on a "history" system -- basically a log of changed data -- in 2007. However, we quickly ran into the problems outlined above and more. I spent many man-hours trying to get it to work in the early 2010s, but eventually had to give up because the underlying approach was flawed. Ahasuerus 18:42, 10 January 2017 (UTC)
Ultimately, we need version control basically -- that is the only thing that will cover all changes from all sides :) But building that in a system not designed for it can be challenging. Annie 17:35, 10 January 2017 (UTC)
In a way, publication snapshots will be a versioning system of sorts. We'll need to add a warning about potentially broken links, but the textual part should be very close to what the data looked like as of the time of the edit. Ahasuerus 18:42, 10 January 2017 (UTC)

2017-01-08 downtime @8PM

The server will be unavailable between 8pm and 8:05pm server (US Eastern) time tonight. I expect that about 3,800 titles will have a language code auto-assigned to them. Ahasuerus 00:28, 9 January 2017 (UTC)

We are back up. Ahasuerus 01:03, 9 January 2017 (UTC)

2017-01-09 server downtime @ 11am

The server will be unavailable between 11am and 11:05am server (US Eastern) time. Approximately 4,500 titles will have a language code auto-assigned. Ahasuerus 15:40, 9 January 2017 (UTC)

The server is back up. Ahasuerus 16:03, 9 January 2017 (UTC)

Language assignment road map

Here is a breakdown of language-challenged titles as of this morning:

| title type   |    count |
| COVERART     |    19627 |
| INTERIORART  |     8764 |
| ESSAY        |     7457 |
| INTERVIEW    |      218 |
| NOVEL        |    36248 |
| NONFICTION   |     4407 |
| POEM         |      751 |
| REVIEW       |     2065 |
| SHORTFICTION |     6356 |

It looks like all (or almost all) of them are associated with NOVEL and NONFICTION publications. I plan to change the cleanup report to include NONFICTION titles next. Once they have been cleaned up, we can tackle NOVELs. We'll probably have to do it one letter at a time. The rest of the titles are in NOVEL and NONFICTION pubs and will be handled via auto-assignment. Ahasuerus 16:13, 9 January 2017 (UTC)

Can you pull a list of what publishers are those novels from? Maybe there are some that do not even need eyeballing them... Annie 16:28, 9 January 2017 (UTC)
Yes, publishers is something that I was going to look into. Also, it's very likely that the 10,400 novels whose title starts with a "The" are English. Ahasuerus 16:48, 9 January 2017 (UTC)
Yes, every single title I looked at that starts with "The " (with the space) was English. I think you can safely just set those to English. Also, look at prices - anything in pounds is English. US$ has a few Spanish ones just to annoy us but I do wonder if we cannot just set them to English and call it a day (and errors can be fixed later?). Annie 17:01, 9 January 2017 (UTC)
As I recall, a number of early non-US publications contained a US$ price due to the way the data was originally imported. A lot of them have been cleaned up/deleted over the years, so perhaps it's not a problem any more. I guess we'll have a better idea once we process the letter 'A'. Ahasuerus 17:41, 9 January 2017 (UTC)
"A" will be very English-slanted because of the indefinite article... I'd rather see "D" as a first letter (which will get the Die/Der/Das from German or "L" (for the French) which have better chances to actually have non-English  :) Annie 17:44, 9 January 2017 (UTC)
Oh yes, that's a good point. Ahasuerus 17:52, 9 January 2017 (UTC)

(inindent) A quick question - if a short story is in 2 collections and both collections are set to English, will your automation set the story to English too (provided that all that is in the collection is either English or not set)? While doing the Italian variants I keep stumbling on whole anthologies and collections where the containers are set to English but not all the stories are (or none in some cases) (because one of the containers is Italian most likely). So when I get the Italian out from the equation, will your script catch these and assign English to them? Annie 17:58, 9 January 2017 (UTC)

The script checks how many languages each pub is associated with. If it's 0 or 2+, then it ignores the pub. If it's 1, then that language is assigned to all language-less titles in the pub.
If a publication contains Italian and English titles, then the script will skip it. If and when an editor changes the pub to contain only English or only Italian titles, it will be processed by the script the next time it runs. HTH! Ahasuerus 18:29, 9 January 2017 (UTC)
Yeah, it did (for one case). An example: Senhor Zumbeira's Leg. The Italian pub should be out when my recent edit is accepted which should mean that this one gets its language set next time the script run, correct? I am figuring out if I can leave these alone or if I should set them to English while I am around :) Annie 18:35, 9 January 2017 (UTC)
That's right. I have tested it on the development server and the script assigned "English" to this title. Will the wonders of modern science and technology ever cease?! Ahasuerus 18:46, 9 January 2017 (UTC)
Great! Thanks for the confirmation. I just did not want it to be left behind and then to have to deal with it in 3 months again. Annie 18:48, 9 January 2017 (UTC)

(unindent) The cleanup report has been updated to include NONFICTION titles. The data will become available tomorrow morning. Ahasuerus 00:46, 10 January 2017 (UTC)

4357 English ones, 1 Spanish, 1 French. Once my pending are cleared, you can get the 4357 assigned automatically. Annie 17:22, 10 January 2017 (UTC)
Actually 4356 English and one in Klingon but as we do not support Klingon, English is the only option for it :). Unless if you want to add a new language "Other" which can be used for this and for any multi-language work. Annie 17:25, 10 January 2017 (UTC)
Great, thanks! I will re-run the script shortly. Ahasuerus 18:46, 10 January 2017 (UTC)
For the record: All "The " And "A " were English (still thinking on how to deal with the novels). Annie 19:24, 10 January 2017 (UTC)
Thanks. I have updated the script to auto-assign "English" to all language-less NOVELs and SHORTFICTIONs whose title starts with "The ". It should gain us almost 20,000 auto-assigned titles, which is nice. I plan to run it on the live server shortly. I will then update the nightly script to include NOVELs whose titles start with a "D" -- we'll see what it will find. Ahasuerus 19:34, 10 January 2017 (UTC)
Why don't you add the ESSAYs to the automated English for titles starting with "The " as well? The ARTs probably will also be ok (Interviews and Reviews can be cross-language (English books reviewed in FRench and vice versa) but the arts and the essays should be safe? And even the poems... Annie 19:38, 10 January 2017 (UTC)
Another good point. I have updated the script to include ESSAY and POEM titles.
I am a bit hesitant to handle COVERART and INTERIORART titles automatically because they seem to have a fair number of incorrectly assigned languages. Once we process the remaining 25,800 NOVEL titles, the auto-assignment process should take care of the rest. Ahasuerus 19:50, 10 January 2017 (UTC)
German novel with no language with a "The " cover with no language will end up as an English novel once the cover gets English and the Novel get assigned based on that. You are right, the arts will need to be after we deal with the Novels. What I was thinking of was a German novel with a set language with a cover with no language where the cover starts with a The which did not get assigned based on the novel because of something else in it blocking it. But these will wait a bit. Annie 19:57, 10 January 2017 (UTC)
Incorrect languages won't be fixed though - the only reason to be worried is the case above where a wrong assignment will also wrongly assign the title to a novel Annie 19:57, 10 January 2017 (UTC)
True enough. Ahasuerus 20:07, 10 January 2017 (UTC)
On the interviews (as we have only 218 language-challenged ones) - can you get them into the report tonight together with the "D" novels? Annie 19:57, 10 January 2017 (UTC)
Sure. There are only 108 interviews left. Here is where we stand right now:
| count(*) | title_ttype  |
|    13613 | COVERART     |
|     7274 | INTERIORART  |
|     4999 | ESSAY        |
|      108 | INTERVIEW    |
|    25827 | NOVEL        |
|      586 | POEM         |
|     1849 | REVIEW       |
|     4370 | SHORTFICTION |
Ahasuerus 20:07, 10 January 2017 (UTC)
My edit to ask you for a new breakdown got blocked by you posting a breakdown :) Would you like to update the multi-language report to include (no-language, language) as a valid mismatched pair as well? Or wait until we clear the novels so the language-challenged "The " arts can be handled as well? Annie 20:11, 10 January 2017 (UTC)
Well, once we finish the language assignment process, it should be impossible to create new titles without a language. At that point I will simply change "Container Titles without a Language" to "Titles without a Language" and wait to see if any new offenders pop up. I will also handle the infamous "Undefined" language. Ahasuerus 20:18, 10 January 2017 (UTC)
Which reminds me - can we get a list of those "undefined" so we can see what these are and get them to their proper languages? Annie 20:24, 10 January 2017 (UTC)
I plan to add them to the "Titles without a Language" report (see above.) Ahasuerus 20:43, 10 January 2017 (UTC)
Somehow managed to miss the last sentence. Sorry :) Annie 21:24, 10 January 2017 (UTC)
BTW, I was surprised by the number of language-less REVIEWs left -- surely we didn't have that many reviews in NOVEL publications? -- so I spot-checked a few. It turns out that they were parents of pseudonymously published REVIEWs. I guess it means that we will have to handle them and other pub-less titles manually. Ahasuerus 20:18, 10 January 2017 (UTC)
Yeah, we have a lot of stories, essays and arts like that as well (I kept finding them and finally realized why they are still around even when the child is ok - they are not part of a container - I do not think it is just parents of pseudonymously published - it is any parent which is not part of a publication and that was created before the mandatory language was added to the DB). Annie 20:24, 10 January 2017 (UTC)

(unindent) OK, the report has been updated to include interviews and "D" novels. The data will become available tomorrow morning. Ahasuerus 22:28, 10 January 2017 (UTC)

"D" novels are cleared. 2090 English ones and 1 German one (pending its language assignment now). I will look through the interviews in a bit. If you want to add another letter, I can look at it tonight. Can we try L or I (or both) - I am chasing other language definitive articles basically... If they end up having the same number of non-English, we may be looking at a very English dominated lists (not that this is surprising) Annie 17:26, 11 January 2017 (UTC)
Interviews cleared as well (as soon as my pendings are cleared and I can finish the varianting and language assignments there). 3 needed unmerging to pull German versions out from the English ones (same name), 105 are pure English. A few inside of novels, all the others were parents that are not part of any publication. Annie 18:09, 11 January 2017 (UTC)
Approved, thanks! There are 795 eligible "I" novels and 878 "L" novels. They will be out next guinea pigs. Ahasuerus 18:33, 11 January 2017 (UTC)
Last set of variants also submitted after the last unmerge. Do you also want to throw the poems into the mix so I can slowly start clearing them as well? There aren't too many of them. Annie 18:39, 11 January 2017 (UTC)
Sure. I am running the changes on the development server and plan to deploy them within the next hour.
BTW, I have identified a scenario which may result in the creation of a language-less title even after we finish the auto-assignment project. When cloning a publication, the logic uses the language of the original pub's reference title when adding manually entered titles to the database. However, if you clone a publication without a reference title, the logic defaults to "no language". It should be a very rare occurrence since we have a cleanup report that finds publications without a reference title, but it's possible. Ahasuerus 22:48, 11 January 2017 (UTC)
So once we are done with the major language assigning, let's have a report that find languageless titles - which will be mostly empty but will catch these as well. However - that also will mean that neither the editor, nor the moderator realized that the language is missing... So even of the software can do these, I hope we won't see a lot of them remaining lagging around. I tend to go and check all of my submissions once approved to make sure something like that does not need adjusting... Annie 23:47, 11 January 2017 (UTC)
We have been slowly expanding "Titles without a Language" to cover additional title types. The day we finish the auto-assigning project will also be the day the logic will be expanded to cover all title types -- which is what you are asking for :-) Ahasuerus 23:51, 11 January 2017 (UTC)
Ah, yes. You are right. I lost track of all the reports for a little while here :)
All of the 227 items in the cleanup report "Art Titles by Non-English Authors without a Language" are artworks in English-language publications. (except for no. 102 "Science Fiction. Five Stories = Science Fiction. Fünf Geschichten" which is the cover of a bilingual pub. with no assigned language) --Vasha 23:38, 11 January 2017 (UTC)
In this case I had been assigning the smaller language - so in this case put German. :) Or in case of more than 2, whatever the publisher language is. And so on.  :) Annie 23:47, 11 January 2017 (UTC)

(unindent) "L" and "I" novels cleared - 2 Italian, 3 Spanish and 1658 English one. As soon as my pending are accepted, the rest can get automatic language. Poems next. Annie 20:04, 12 January 2017 (UTC)

Poems cleared as well - all English. Most of them parents of variants or non-attached; a few are inside of novels and the rest are in the multilanguage works that are still not cleared. Annie 20:55, 12 January 2017 (UTC)
Great, thanks! Here is where we will be after the next iteration of auto-assignment:
| title_ttype  | count(*) |
| COVERART     |    11881 |
| INTERIORART  |     6960 |
| ESSAY        |     4906 |
| NOVEL        |    22037 |
| REVIEW       |     1849 |
| SHORTFICTION |     4337 |
Would you like to tackle reviews next? Or perhaps some subset of novels? Here are the new counts (non-alpha characters excluded):
| letter | count(*) |
| A      |     2149 |
| B      |     1697 |
| C      |     1641 |
| E      |      828 |
| F      |     1140 |
| G      |      892 |
| H      |     1017 |
| J      |      361 |
| K      |      432 |
| M      |     1512 |
| N      |      634 |
| O      |      590 |
| P      |     1096 |
| Q      |      103 |
| R      |     1056 |
| S      |     3030 |
| T      |     1582 |
| U      |      248 |
| V      |      412 |
| W      |     1273 |
| X      |       29 |
| Y      |       78 |
| Z      |      119 |
Ahasuerus 22:24, 12 January 2017 (UTC)
Reviews and the Q, X, Y and Z novels (the smallest groups so they are off our plate)? Annie 22:30, 12 January 2017 (UTC)
Sure, can do. Ahasuerus 22:57, 12 January 2017 (UTC)
If you have a trivial way to find the non-alpha ones as well, I'd take them - if not, they will come with the last letters. Annie 22:30, 12 January 2017 (UTC)
There are approximately 100 non-alpha language-less NOVEL titles. Once the alpha titles have been processed, I'll change the logic to include all language-less NOVELs. At that point all non-alpha novels will appear on the report. As Marty would say, "Magic!" :-) Ahasuerus 22:57, 12 January 2017 (UTC)
Which is why I said "trivial" :) They will show up in an All report so not too worried :) Annie 23:05, 12 January 2017 (UTC)
And we will probably need to split these short stories and essays into groups as well I suspect- most of them will be parents that won't get assignments from anywhere else and they are too many for a single list... Annie 22:30, 12 January 2017 (UTC)
I hope that a fair number of introductions, afterwords and excerpts will be auto-assigned, but there is no easy way of telling until we get there. Ahasuerus 22:57, 12 January 2017 (UTC)
If the ones I cleared so far are any indication, I would not hold my breath. Annie 23:05, 12 January 2017 (UTC)
Come to think of it, there is a way to tell by creatively abusing the development server. If I change the language of all unassigned NOVELs to English and re-run the auto-assignment script, it should give us a rough idea of what will remain outstanding. Let me give it a try...
OK, here are the post-NOVEL/post-REVIEW counts:
| title_ttype  | count(*) |
| COVERART     |     2219 |
| INTERIORART  |     5442 |
| ESSAY        |     4342 |
| SHORTFICTION |     4203 |
Not perfect, but I think it should be manageable.
In any event, I have updated the cleanup report to include reviews and the X,Y,Z novels. The data will be available tomorrow morning (or late at night for those on the West Coast.) Ahasuerus 23:59, 12 January 2017 (UTC)
Sounds about right on the textual ones. I wonder where all those INTERIORART are and why the automation does not handle them - we cannot have 5000+ parents out there, can we? Annie 00:08, 13 January 2017 (UTC)
Spot-checking suggests that some are parents while others appear in mixed language art books. Ahasuerus 00:58, 13 January 2017 (UTC)
Ah, those. I had been leaving them alone for now while clearing the rest of the multilanguage ones. Thanks for checking! Annie 01:06, 13 January 2017 (UTC)
X-Z novels are cleared - all are English. The Reviews will take a bit longer to clear :) Annie 18:41, 13 January 2017 (UTC)

(unindent) And that is all for the reviews - one need splitting (already submitted) and then varianting so the two pieces can get English and German as languages, everything else remaining is English. I did submit a few small changes (capitalization and 2 not-cleared Russian name). So the current list (all reviews plus X-Z novels) are clear for automatic English. Sorry it took me that long - real life intervened. Would you want to get me the U-W novels next? Annie 23:18, 26 January 2017 (UTC)

Excellent, many thanks! Sure, I will add U, V and W to the cleanup report shortly. Ahasuerus 03:29, 27 January 2017 (UTC)
The cleanup report has been updated. The new data will be available in another 80ish minutes. Ahasuerus 05:08, 27 January 2017 (UTC)
Now that was boring... All U-W language-challenged novels are English. Can I see the the G-K novels next? Annie 18:35, 27 January 2017 (UTC)
Sure, coming right up... Ahasuerus 19:26, 27 January 2017 (UTC)
Done. Ahasuerus 00:03, 28 January 2017 (UTC)

(unindent) G-K novels are cleared - all English :) Annie 19:15, 1 February 2017 (UTC)

Thanks! I will update and re-run the scripts shortly. I will also start a new Community Portal section since this one has become unwieldy. Ahasuerus 01:39, 2 February 2017 (UTC)

So is the chapbook that appeared at the bottom of the list: Standard Hollywood Depravity. How was that added without a language at all? I did not think that we can have this case anymore? Annie 19:15, 1 February 2017 (UTC)

<checks submission history> I see. The original NewPub submission created a proper English NOVEL title. I then went back and created an EditPub submission to change the publication and the title from NOVEL to CHAPBOOK. I also added a new SHORTFICTION title to the pub. Due to the fact that these changes were made in the same submission, the auto-assignment algorithm couldn't find a reference title, which is why it failed to assign a language. It may be possible to tweak the auto-assignment algorithm to be more robust, but even if it proves challenging, I expect that the number of exceptions should be manageable. Ahasuerus 01:39, 2 February 2017 (UTC)
Ah I see, that makes sense. I agree - we should not see a lot of these. Annie 04:20, 2 February 2017 (UTC)

Once you get those all set to English, can I see the "A" novels? Annie 19:15, 1 February 2017 (UTC)

Will do. Ahasuerus 01:39, 2 February 2017 (UTC)

Author Note field

Two items I just came across made me think that having a Author Note field would be useful to record information; see this submission which gives helpful source information for added info and this conversation about an author's language.

This type of information seems similar to how we document publications; I know we used to keep extra stuff like this in the Bibliographic Comments section of the Wiki, but it seems like we're moving towards including those things into the DB when they can be accommodated.

I didn't see a FR for this when I searched, but I could have missed it. Albinoflea 22:49, 9 January 2017 (UTC)

That would be FR 307, Move "Author" and "Bio" pages from the Wiki to the database.
The current plan is to:
  • finish the process of migrating Series/Publication/Publisher notes to the database proper
  • decide whether author records should have a single "Note" field or two fields, "Note" and "Biography"
  • implement the change
Ahasuerus 00:08, 10 January 2017 (UTC)
Ah... yes, that sounds familiar now. I must not have scrolled back far enough... Do we know how many existing Author Biography pages live in the Wiki? Albinoflea 01:34, 10 January 2017 (UTC)
As of last March:
  • Bibliographic Comments pages: 1,636
  • Bibliographic Comments Talk pages: 33
  • Biography pages: 1,896
  • Biography Talk pages: 1
Ahasuerus 02:05, 10 January 2017 (UTC)

2017-01-10 server downtime - 2pm and 3pm

The server will be down for the next iteration of language auto-assignment between 2pm and 2:05pm server (Eastern US) time. Ahasuerus 18:47, 10 January 2017 (UTC)

The server is back up. Ahasuerus 19:03, 10 January 2017 (UTC)
There will be another downtime at 3pm. It should only last 2 minutes and gain us about 20,000 auto-assigned titles. We are getting there! Ahasuerus 19:39, 10 January 2017 (UTC)
Everything should be back up. Ahasuerus 20:02, 10 January 2017 (UTC)

2017-01-11 downtime - 5pm

The server will be down for the next iteration of language auto-assignment between 5:30pm and 5:32pm server (Eastern US) time. Ahasuerus 22:05, 11 January 2017 (UTC)

The server is back up. Ahasuerus 22:32, 11 January 2017 (UTC)

Change in the publication view

Based on a small discussion here: here, here is a proposal for changing in the publications view. At the moment, when the variant of a title has a different language than the original, the software renders that as a translation in the publication content view. When the variant is an Interior Art, that does not look accurate. So the proposal is to treat is a variant and not as a translation so in Bilbon viimeinen laulu:
instead of
Bilbon viimeinen laulu • interior artwork by Pauline Baynes (trans. of Bilbo's Last Song 1990)
we will get
Bilbon viimeinen laulu • interior artwork by Pauline Baynes (variant of Bilbo's Last Song 1990)

Anyone with any opinion on this? Agreement? Disagreement? I do not care? Something else? Annie 00:08, 12 January 2017 (UTC)

That makes sense to me. Albinoflea 19:58, 12 January 2017 (UTC)
Sounds good. --Vasha 22:46, 12 January 2017 (UTC)
That's appropriate. While I know there are some instances of art with English text that has been converted to the same art with, say, German text, and hence should properly be viewed as a "translation", I believe that is rare, and could be handled by a note. Chavey 02:12, 13 January 2017 (UTC)
I'd think that shouldn't be so even in such a case: the moment we view something as INTERIORART we decide to drop the focus on the language; and a note like 'Involved text was translated by Gandalf Gremlin' would still be an option.
It'd be possible to view a comic or even a cartoon as SHORTFICTION (with illustrations), but I think there were good reasons to not pursue this line of thought. Stonecreek 07:05, 13 January 2017 (UTC)

(unindent) Looks like a consensus to me! The software change has been made and deployed. Ahasuerus 21:12, 13 January 2017 (UTC)

Poems not attached to publications

Before I submit deletions for the ones I am finding (a lot of them have no language assigned - which is how I am finding them), is there any reason to keep in the DB poems like this one: A Description of Morning when they are not part of a publication and are not a parent for a variant that is part of a publication. Thoughts? Annie 20:36, 12 January 2017 (UTC)

If it's a valid genre work, it should remain. It's possible to know a work is genre, but not have information regarding the specific publication. Ideally, there would at least be a note with some information why the record is present, but doesn't always happen. -- JLaTondre (talk) 21:08, 12 January 2017 (UTC)
I am not sure that some of the ones I saw were valid genre works but I'll leave them alone. I think we should at least have a "first published in" note for these... Annie 21:14, 12 January 2017 (UTC)
"A Description of Morning" is available on-line and is clearly non-genre. I deleted it. -- JLaTondre (talk) 01:40, 13 January 2017 (UTC)

2017-01-12 server downtime - 5:45pm

The server will be down between 5:45pm and 5:47pm server (Eastern US) time. Ahasuerus 22:25, 12 January 2017 (UTC)

Done. Ahasuerus 22:47, 12 January 2017 (UTC)

Fictionalized biography of Edgar Allan Poe

A question about inclusion / exclusion. We include non-fiction biographies of important authors. I couldn't find anything that seemed to address the issue of a fictionalized biography. The book "Dark Glory", by Dorothy Dow, is such a work. "A Companion to Poe Studies" says the book "confines its fiction principally to imaginary conversations and to narrative commentary and interpolation". At least one source I found lists the book as non-fiction, although it really isn't. Does this book belong in here? Chavey 02:07, 13 January 2017 (UTC)

If the truly non-fiction equivalent is "in", I'd say this should be, too. It's still about Poe. --MartyD 02:48, 13 January 2017 (UTC)
And I included such an item for H. G. Wells, because of his importance. Stonecreek 07:07, 13 January 2017 (UTC)
Thanks for the advice. Poe is certainly at a fairly high level of importance. I'll add the book. Chavey 05:40, 14 January 2017 (UTC)

Spanish speaking editor up for a challenge?

The stories here Fábulas need to be replaced with their Spanish variants. My google-fu does not seem to work very well for that one so can someone that speaks Spanish take a look and see if they can find the names of the stories and who translated each (if possible)? I don't even mind doing the varianting and replacing if someone can get the data and post it... Annie 20:15, 13 January 2017 (UTC)

I do not believe that the complete table of contents is online anywhere. [ Here] is one of the translated stories, but using its title as a clue didn't allow me to find the rest. If no one else speaks up, I will put in an ILL request; there's a copy at a public library in my state. --Vasha 21:20, 13 January 2017 (UTC)
Thus the challenge part of my question :) Thanks! Annie 21:31, 13 January 2017 (UTC)
It's a later edition from Lectorum, but I think this is the same collection. The prologue is dated Buenos Aires, 1983 (although it is credited to both Borges and Alifano). I will enter this edition and match the English and Spanish titles. We can see how its contents correlate with that other pub we have. --MartyD 12:30, 16 January 2017 (UTC)
The contents matched 1-for-1, so I swapped out all of the English titles for the Spanish. --MartyD 14:11, 16 January 2017 (UTC) / Request: Add The Witch Who Came In from the Cold

The February 3 issue of, which I have added, has a review of the first three episodes of the Serial Box serial The Witch Who Came In from the Cold (not yet in the DB). Now I am not sure how to add that serial; but their previous production Bookburners provides a model. Would anyone like to enter The Witch... into the DB and link the review to it? (Currently I have the article as ESSAY not REVIEW). --Vasha 02:44, 16 January 2017 (UTC)

Am I missing something? Why are we including's non-fiction? It is a blog, not a webzine. We include their fiction under the SFWA recognized market exception since it's by notable writers and/or frequently later collected in publications. I don't see the point of including their Batman, Star Trek, etc. rewatches and other non-fiction. Unless there is a downloadable version that I'm not aware of, we should be sticking to only the fiction. -- JLaTondre (talk) 11:35, 16 January 2017 (UTC)
that would make things easier... I have been entering everything on the assumption that it was being called a magazine. Are there other cases of something that is not a magazine where the fiction is entered? --Vasha 14:18, 16 January 2017 (UTC)
I know I have accepted some of these additions on the mistaken understanding that it's both the website and emailed newsletter. Upon further review, I see now the newsletter is something different. --MartyD 14:27, 16 January 2017 (UTC)
What exactly is the "periodical" that publishes the fiction? I think that ought to be clarified. There should be someplace in the DB to note that. If the stories are not being published in any periodical, how are they to be catalogued?
Here's a thought. These stories are always published individually as e-chapbooks. We do catalogue them in that form, as by the publisher (which also puts out novellas). Stories appear simultaneously on the blog and in chapbook form. If we decide that the blog is not a webzine, then maybe we should not list the appearances of stories there, but only their chapbook publication. --Vasha 20:19, 16 January 2017 (UTC)'s fiction was original entered (per my impression) as a webzine as we have no way to handle a blog and it was the closest thing. While they may also release them as ebooks now, that wasn't the case originally. For example, the first story we have indexed is After the Coup which was published on in 2008, but not released as an ebook until 2010. Treating the original posts as a webzine seems reasonable to me given our explicit criteria that we will carry SFWA recognized markets, but extending that to all their blog posts doesn't. A note can be added to the to explain how and why we are handling these somewhat differently than normal. I've put your current edits on hold pending further community feedback. If no one else argues for inclusion, I will go through and remove the non-fiction. Please don't take this negatively, we do appreciate your attempt to make the database more complete and accurate. -- JLaTondre (talk) 22:05, 16 January 2017 (UTC)
I vote for the deleting of the non-fiction. If we want to list every essay about SF available on the web, we're going to be flooded by the material (I'll be even able to enter the 600+ entries in my blog, great!). Hauck 18:32, 17 January 2017 (UTC)
I agree - do not have a webzine the way Strange Horizons does for example (their non-fiction is part of their webzine). As much as I like completeness, allowing these in opens the door for allowing reviews from non-genre media for genre books in and that will spiral out very fast. Annie 18:47, 17 January 2017 (UTC)

(outdent) As there have been no objections, I have removed the non-fiction. I have also added a note to the series record. -- JLaTondre (talk) 03:23, 19 January 2017 (UTC)

Thanks... sorry to make extra work for you. After I finish adding the contents to this year's Clarkesworld, I will put in the remaining short fiction. --Vasha 03:46, 19 January 2017 (UTC)

2017-01-16 downtime - 6:30pm

A big patch will be installed at 6:30pm server (US Eastern) time. The server will be down for a few minutes. Patch notes to follow. Ahasuerus 23:12, 16 January 2017 (UTC)

The patch has been installed and the server is back up. As per FR 163, the "storylen" field has been split into 4 fields:
  • a "Story length" field proper
  • a "Content" field for omnibus designations like "1-4". Please note that you no longer need to enter "/" as the first character.
  • a check-box for "juvenile"
  • a check-box for "novelization"
The "New publication" page has been adjusted to support entering these values directly, without having to wait for submission approval. There are new cleanup reports for parent/variant mismatches associated with the new fields. Lots of other data entry forms - "Make Variant", "Add Variant", "Merge Titles", "Unmerge Titles", etc -- have been adjusted. The "juvenile"/"novelization"/Content data has been moved from the old "story length" field to the new fields.
If you see anything unusual, please report your findings here. I will update Help shortly. Ahasuerus 23:43, 16 January 2017 (UTC)
Hurrah! thanks for this. --Vasha 23:44, 16 January 2017 (UTC)
BTW, I would like non-genre to be at the top of the list; I use it much more often than the others. I don't care about the order of the others. --Vasha 23:50, 16 January 2017 (UTC)
Sure, that's easy to do. Unless there are objections in the next 24-48 hours, I will make the change on Wednesday. Ahasuerus 00:05, 17 January 2017 (UTC)
Done. Ahasuerus 20:41, 18 January 2017 (UTC)

(unindent) AddVariant is missing the checkboxes. Will it inhetrit all the new values from the mother work (juvenile/novelization)? Annie 20:33, 18 January 2017 (UTC

That's right. When you create a new title record using Add Variant or Make Variant, the new record inherits the original record's juvenile/non-genre/graphic/novelization/content values. Ahasuerus 20:40, 18 January 2017 (UTC)

Further "story length" changes

The "Story Length" field is now a drop-down list in all data entry forms. Moderator review pages still refer to its values as "ss", "nv", and "nt", but I expect to change everything to "short story", "novella" and "novelette" in the near future.

The name of the field has been changed to "Length" to make it consistent with the way it appears in Edit Publication. More streamlining of various Web pages to follow. Ahasuerus 18:03, 17 January 2017 (UTC)

Query to other editors; would you like to see the options rearranged in the order ss, nt, nv (I would) or are you too used to the existing order? --Vasha 18:43, 17 January 2017 (UTC)
novelette is the least common format (at least with the things I seem to read) so I would rather have it at the bottom. But I can live with them reordered Annie 18:48, 17 January 2017 (UTC)
I have been entering dozens and dozens of anthologies and magazine issues lately; I'd say they are 95 percent short stories, 5 percent novelettes, and almost no novellas. Where are you finding so many novellas? --Vasha 19:06, 17 January 2017 (UTC)
Separate chapbooks from a few publishers for the most part (favorite length so I am seeking them out usually). Novellas are hard for anthologies because of their length - so I am not that surprised at your stats. As I said - I can live with it either way. Annie 19:13, 17 January 2017 (UTC)

(unindent) As of Saturday morning:

| count    | storylen       |
|    39561 | nt             |
|    19226 | nv             |
|   181918 | ss             |

19:30, 17 January 2017 (UTC)

The latest batch of "story length" changes was installed a few minutes ago. It rearranged the "Add Variant" page to look the way Edit Title looks. It also changed all occurrences of "Story Length" and "Storylen" to "Length" to make it consistent. Ahasuerus 20:26, 18 January 2017 (UTC)
In reply to Vasha above, I prefer to see the existing order in the drop-down menu (novella, short story, novelette) because with short story in the middle it neatly separates the two similar words, and inclines editors away from unintentional mistakes. Am I alone in always thinking this was a cunning design trick? ;) PeteYoung 20:50, 18 January 2017 (UTC)
Hm, that's a good point. You're probably right. --Vasha 23:09, 18 January 2017 (UTC)
I always have to look up the definitions of novella and novelette, because I can never remember which one is shorter. So I, at least, would strongly prefer that they be listed in length order. Chavey 04:02, 21 January 2017 (UTC)
The longer the name, the shorter the story  :) I used to mess up novel and novella when I was still learning English. So had to find a way to differentiate the two and the length of the word helped. Then I learned that there is a novellete as well - and the rule for the lengths saved the day. Annie 05:06, 21 January 2017 (UTC)
Thanks! Chavey 05:25, 22 January 2017 (UTC)

2017-01-17 server outage - 4:45pm

The server will be briefly unavailable around 4:45pm server time. It should be back up within a minute or two. Ahasuerus 21:32, 17 January 2017 (UTC)

Sorry, that was supposed to be "4:45pm server time". Ahasuerus 21:40, 17 January 2017 (UTC)
The server is back up. A couple of cleanup reports have been adjusted to work with the new "story length" logic. Some very old titles with messed up story length values have been corrected. Ahasuerus 21:47, 17 January 2017 (UTC)

German editor with some time?

The PV is not active anymore so cannot ask him... And I cannot find the German content online. So can someone find the German titles of Im höchsten Grade phantastisch? Thanks! Annie 19:09, 18 January 2017 (UTC)

The available sources seem only to list the nonfiction as such, not the contents. I'll see if I can get hold of a copy, but in any case this'll take some time. Stonecreek 12:18, 22 January 2017 (UTC)
Done. Stonecreek 18:24, 13 February 2017 (UTC)
Wonderful - thanks! Annie 18:31, 13 February 2017 (UTC)
Glad to have been of some use! (Back when this book and others were added & verified the use of the English language was state of the art: there wasn't any other option). Stonecreek 19:20, 13 February 2017 (UTC)

Removal of non-genre and graphic check-boxes for REVIEWs and INTERVIEWs

The "non-genre" and "graphic format" check-boxes are no longer displayed when editing REVIEWs/INTERVIEWs. Ahasuerus 18:56, 19 January 2017 (UTC)

And here I was looking forward to seeing some comic book reviews of speculative fiction works (*laugh*). Uzume 00:10, 27 January 2017 (UTC)

Coming patch and pending submissions

I have a fairly big software patch almost ready to go. It will wrap up most of the outstanding issues with the "story length" field, including finally changing "shortstory" to "short story". I plan to install it on Monday at 9pm server time. Unfortunately, the patch will invalidate any pending submissions which affect "story length" values; they will need to be rejected. Please plan accordingly. Ahasuerus 00:01, 22 January 2017 (UTC)

Change Empire Star to novella?

We currently have Empire Star by Samuel R. Delany as a novel (presumably because the halves of Ace Doubles are conventionally considered novels) but it's less than 27K words. If people want to change it to a novella, I will be happy to do the work. The same with another by the same author, The Ballad of Beta-2, which is 30K words. --Vasha 22:10, 23 January 2017 (UTC)

This has been raised before in relation to other works, although not specifically Empire Star and The Ballad of Beta-2 as far as I know. Yes, they are technically novellas as are probably the majority of 'Ace Double' titles that we currently have listed as novels, but to make such a change would first mean having to notify the many PVs of your intention that would change all their publications. You'd also need to change many records into CHAPBOOKS, create title records for each one and merge. And then there are the translations to consider. The simpler and far less labour-intensive option is just to make a note in each of the title records (1, 2) about the word count. I can't speak for other editors but that would be my recommendation. PeteYoung 04:16, 24 January 2017 (UTC)
Well, as is often the case of many-published works, many of the PV1s aren't active anymore, and I'd think that most of the other PVs didn't think about the works length when verifying. So, as the community portal is exactly for communal decisions, I'd say it'd be okay to change the titles to novellas if there isn't a neglection within the next few days. Our rules of categorization are to the point and we shouldn't deviate without a reason from it (the reason for the category 'novel' here, I think, is that the publisher called them so; this is quite often only a marketing ploy: novels sell better than novellas). Stonecreek 04:49, 24 January 2017 (UTC)
Okay, I propose a new operating procedure. As the titles seem to get only copied and verified by editors without taking a second look at the actual length, there seems to be the practicable way of asking the first active PV and possibly making the change following the okay. Stonecreek 17:29, 13 March 2017 (UTC)
No, there's now a trend to proceed this way (only notifying one PV on nebulous criteria -active?, 1st?- and leaving the others "unnotified") that is presently particularly annoying (it's used now for additions of letters to magazines). All (active) PVs are equals and should be notified, we can't have a process based on the hope that every PV follow all what happens on the "recent changes" page and that they remember that they PVed this pub. I'm perfectly aware that Empire Star and a lot of other texts that I PVed are novellas listed as novels but I followed the usage of the times. Hauck 18:38, 13 March 2017 (UTC)
I didn't say I'd not notify them, but only for asking the first active PV. Most PVs seem to be only seldomly active (or not at all anymore), so that's a way that things never get done. This would mean an active active PV (somebody who's around at least a few times a week) and a note here on the community portal. Stonecreek 19:59, 13 March 2017 (UTC)
That's what bother my old egalitarian self. Why only ask "the first active PV" (as if his/her opinion carried more weight) and just who is "the first active PV" anyway? (the one with the lowest number?, the one with the lowest number multiplicated by the difference between his last posting and today divided by the square root of his/her number of contributions?) or more simply what is an "active PV"?.Hauck 07:57, 14 March 2017 (UTC)
But it is just a notification - what's the problem in posting on all PVs pages - even if one does not wait for them to respond? Someone that is here once a month is more likely to read their page than to wade through all the chatter we produce on the Community Portal. By all means - not waiting for everyone to agree is fine (especially with an agreement in the Community Portal) but not notifying everyone is poor etiquette (I think). Annie 20:05, 13 March 2017 (UTC)
That's exactly what I meant! Thanks, Annie. Stonecreek 20:06, 13 March 2017 (UTC)
Indeed you did - I think I blanked through part of your last message - sorry. Not enough coffee again aparently :) I was mostly agreeing with Herve above that not notifying is not very nice. Annie 20:34, 13 March 2017 (UTC)
If I took a look at my user page after an absence, I'd like seeing messages about major changes to my verified works (I've often regretted that the DB isn't a wiki with page histories). But I consider that to be nice rather than essential. And admittedly, notifying a bunch of people is work. --Vasha 20:41, 13 March 2017 (UTC)
SFE3 calls these two works novels. I don't have the other secondary sources to check, but I'm willing to bet that most or all of them do the same... Right? That right there is a reason for leaving them as they are; however, since ISFDB aspires to be a resource for casual browsers who aren't familiar with the publishing practices of the 1960s, adding a note is a necessity. --Vasha 20:41, 13 March 2017 (UTC)
If you prefer to let these two as they are, that's fine with me. Chistian Stonecreek 21:18, 13 March 2017 (UTC)
How's this for a note? "This story is 27,000 words long, thus it is a novella by the ISFDB's usual classification. However, it is listed as a novel due both to the publisher having originally marketed it as such (in common with many other very short "novels" at that time), and standard bibliographies listing it as a novel." --Vasha 21:31, 13 March 2017 (UTC)
Drop "ISFDB" from that sentence -- this is the standard classification, not something invented for this DB. Or say something like: "that standard classification (link to it) blah blah". Otherwise the note sounds as if we just came up with some categories here... However - we had been entering a lot of the old dos novels into their correct types (even if the publisher called them novels) so isn't this against the current practice? I would say that we should list it as what it is, not what it is marketed as. Just saying. Annie 21:37, 13 March 2017 (UTC)
Also possible would be to change it and enter a note that this is a NOVELLA, but the publisher and some sources list it as a NOVEL. (It's really the most common publisher's trick to call a text a novel which ain't one). Stonecreek 21:44, 13 March 2017 (UTC)
I don't work much with older publications, so I'd rather leave it to those who do to decide this matter. Those of you who've entered dozens or hundreds of 1960s novels and dos-a-dos publications into the database, what do you want to do? --Vasha 21:57, 13 March 2017 (UTC)
On a related note, with the new "My Changed Primary Verifications" feature, would we necessarily need to notify all of the PVs? The system will advise them when there has been such a change. Just curious, since I thought that was the main purpose of that new feature. ···日本穣 · 投稿 · Talk to Nihonjoe 22:17, 13 March 2017 (UTC)
A notification usually specify what had been changed; the new feature merely highlight which fields are changed (and there is no way to see what was the old value). So yes, notifications are still pretty much part of the etiquette. :) Annie 22:38, 13 March 2017 (UTC)

2017-01-23 downtime at 9pm

As per the note above, the server will be brought down at 9pm server time. It should be back up within 5 minutes. Please note that any outstanding submissions which aim to change "story length" values will be rejected at 8:59pm. Ahasuerus 00:50, 24 January 2017 (UTC)

The server is back up. It was a beefy patch, so if you see anything unusual, please post your findings here. Ahasuerus 02:02, 24 January 2017 (UTC)
Um, yeah... I just tried to submit a new magazine issue and got "Error: invalid shortfiction length". --Vasha 02:10, 24 January 2017 (UTC)
Could you please try to do a full page reload using Control-F5? There was a change to one of the JavaScript files and your browser may still have the old version loaded. Sorry about the hassle! Ahasuerus 02:13, 24 January 2017 (UTC)
In the meantime, here are the patch notes:
  • "shortfiction" has been changed to "short fiction"
  • All occurrences of 'ss', 'nt' and 'nv' have been changed to fully spelled out words
  • A lot of changes under the hood
Ahasuerus 02:16, 24 January 2017 (UTC)
I restarted my browser and now submission works. --Vasha 02:21, 24 January 2017 (UTC)
Great! Ahasuerus 02:36, 24 January 2017 (UTC)

2017-01-26 server downtime at 11:55pm

The server will be unavailable between 11:55pm and 11:58pn server time. Ahasuerus 04:26, 27 January 2017 (UTC)

The server is back up. Ahasuerus 04:57, 27 January 2017 (UTC)

2017-01-27 server downtime at 3:10pm

The server will be down between 2:40pm and 2:43pm server tome. Ahasuerus 19:30, 27 January 2017 (UTC)

The downtime has been rescheduled for 3:10pm due to technical issues. Sorry about the inconvenience. Ahasuerus 19:58, 27 January 2017 (UTC)
The server is back up. Ahasuerus 20:12, 27 January 2017 (UTC)

Spaces after author names

In accordance with this conversation, I have a question for editors: currently, in some places there is an extra space after author names before punctuation like commas and brackets, like [as by Allen M. Steele ]. To me, this looks really weird and offputting & I'd recommend removing it; however, Ahasuerus says that some people find it useful. If that's you, please speak up in favor of keeping the space. --Vasha 22:13, 28 January 2017 (UTC)

As I recall, the argument that was advanced against this change the last time the question came up was that having an extra space made copy-and-paste operations easier under Windows. Ahasuerus 23:30, 28 January 2017 (UTC)
Hearing no objection, so ordered. Ahasuerus 00:07, 8 February 2017 (UTC)

Lisa Tuttle

Lisa Tuttle's 2 short stories: "The Curious Affair of the Deodand" and "The Curious Affair of the Dead Wives" are in the same "Jesperson and Lane" series as her novel The Curious Affair of the Somnabulist and the Psychic Thief. —The preceding unsigned comment was added by RogerSSS (talkcontribs) .

I've added them to the series, but you could do that yourself-- the place for indicating the series is in the title record, right below the date. --Vasha 07:59, 30 January 2017 (UTC)

Is Book Smugglers a blog?

It seems to me that the Book Smugglers' online presence is in the same situation as what we discussed for -- they're a blog rather than a webzine. Would you folks agree? And they're only semipro, so no exception made to index their fiction. I've only been adding their online fiction if they also published it as a chapbook (they didn't always). --Vasha 22:03, 1 February 2017 (UTC)

As the current rules stand - yes, they are a blog so not eligible except if there is a special case for it. Annie 22:49, 1 February 2017 (UTC)

2017-02-01 server downtime at 9pm

The server will be unavailable between 9pm and 9:05pm server time. Ahasuerus 01:40, 2 February 2017 (UTC)

The server is back up. Ahasuerus 02:02, 2 February 2017 (UTC)

Language-less NOVEL cleanup

Here is where we stand as of this evening:

|letter|    count |
| S    |     3001 |
| T    |     1571 |

The letter 'A' will be added to the report shortly. Ahasuerus 02:21, 2 February 2017 (UTC)

Done. Ahasuerus 04:12, 2 February 2017 (UTC)
"A" novels cleared. 2 French ones (waiting to be approved) and a few changes in cases when I spotted them which will get English this way when that gets approved... The rest can get automatic English. How about N-Q next? Annie 19:06, 2 February 2017 (UTC)
Approved and thanks. N-Q coming right up. Ahasuerus 21:22, 2 February 2017 (UTC)
N-Q novels cleared. Nothing non-English in the whole list (some interesting titles though - the genre authors have weird imaginations...). So off with their heads... uhm - I mean, let's assign them all the language automatically. :) E-F next? Annie 18:11, 3 February 2017 (UTC)
N-Q done. The cleanup report has been adjusted to include E and F . Also, I have removed the processed letters from the table above. Ahasuerus 02:38, 4 February 2017 (UTC)
E-F novels are cleared - all English. Even the French sounding one that gave me some hope that something is not English in this group... How about B next? Annie 16:28, 6 February 2017 (UTC)
E and F have been auto-assigned. Thanks for working on them! B should be available tomorrow morning. Ahasuerus 17:03, 6 February 2017 (UTC)
All language-challenged "B" novels are English... :) "C" next? Annie 17:57, 8 February 2017 (UTC)
Done. "C" is in progress and will be available tomorrow morning. Ahasuerus 18:47, 8 February 2017 (UTC)
"C" are all cleared. English all the way down the list (a few formatting issues fixed while I was looking at them anyway). M and R next? Annie 16:17, 9 February 2017 (UTC)
Done and thanks again. M and R will be available tomorrow morning. Ahasuerus 18:38, 9 February 2017 (UTC)
M and R are cleared. S next? Once they are cleared as well, then it will be all remaining novels (T plus the non-letter ones).Annie 18:16, 10 February 2017 (UTC)
Done and done! Ahasuerus 18:54, 10 February 2017 (UTC)
S novels are all clear for automatic English. Time for all novels :) Annie 17:05, 13 February 2017 (UTC)
Done and done. Once the rest of the novels are wrapped up, we will have the following title types left:
| COVERART     |     2961 |
| INTERIORART  |     5546 |
| ESSAY        |     4331 |
| SHORTFICTION |     4154 |
The actual counts will be somewhat lower due to auto-assignment. Also, we could break them down further. For example, a search on ESSAYs which contain words like "Introduction" "Foreword" and "Note" results in approximately 600 hits . Ahasuerus 20:17, 13 February 2017 (UTC)
Except that I had found some Introductions and Forewords that had the English word but were not English (mainly Italian). I'd fix the name on some when I know how but still... So I am not comfortable relying on that alone to call them English... If you mean to allow splitting, a 4K or so list is workable so no need to split those. I think I would take short fiction next - later this week I suspect :) Then Essay, then cover art and at the end we can start chipping at the interior art. Annie 20:47, 13 February 2017 (UTC)
Right, I am aware of non-English "Introductions". I was thinking that making the lists shorter would facilitate the review process, but if lists with 4K titles are manageable, then so much the better! Ahasuerus 21:01, 13 February 2017 (UTC)
Sorry, I had been just playing with all those languages and my mind is going to automatic languages immediately :) I prefer smaller ranges (1-2K) but 4K is manageable for a few ranges :) Annie 21:32, 13 February 2017 (UTC)
And any chance I can get the 234 Undefined ones at some point so I can vet which ones are not English and we can have the rest reset to English? :) Annie 20:45, 3 February 2017 (UTC)
I plan to change all empty string ("Undefined") values to nulls, which will make them appear on the cleanup report. Ahasuerus 02:38, 4 February 2017 (UTC)
Ah, that makes sense (and will probably make it easier to fit with the current process. Thanks! Annie 02:57, 4 February 2017 (UTC)
Any idea when? :) Annie 19:10, 10 February 2017 (UTC)
I plan to convert them right before I change the nightly cleanup report to include all NOVELs. Ahasuerus 19:49, 10 February 2017 (UTC)
Should have waited one more day and it would have become clear. :) Always happens this way it looks like. Thanks! Annie 20:54, 10 February 2017 (UTC)

(unindent) Too many dots so time to unindent. All novels are cleared and require a bit of magic to turn them back into pumpkins... :) Next - short stories.

Excellent! Here is where we stand with the NOVEL titles out of the way:
| COVERART     |     2186 |
| INTERIORART  |     5411 |
| ESSAY        |     4283 |
| SHORTFICTION |     4143 |
Given the much reduced number of COVERART titles, do you still want to attack short fiction first? Ahasuerus 22:26, 14 February 2017 (UTC)
Art gives me a headache with the number of splits and multi-language books - so I would rather deal with the text elements and clear all of them first and then brave the arts :) Annie 22:32, 14 February 2017 (UTC)
Sounds good -- short fiction coming right up! Ahasuerus 22:48, 14 February 2017 (UTC)
Short fiction cleared - there are 4 language assignments pending I think and a few deletions in my pending queue - anything else on the language-challenged list is English. I think I want COVERART next or I will end up with 7500 art titles left at the end... and that won't be much fun :) Annie 00:15, 18 February 2017 (UTC)
2,100 COVERART titles coming right up! Ahasuerus 02:10, 18 February 2017 (UTC)
Can you get me some approximate numbers for interior art and essays groups if we split each of them in 3 groups (A-H, I-S, the rest)? The 4K group is manageable but a bit overwhelming (plus this way I will be able to alternate text and art)... Annie 02:55, 18 February 2017 (UTC)
Sure thing. I'll post the breakdown tomorrow. Ahasuerus 05:05, 18 February 2017 (UTC)

By the way - did you ever reset the Undefined ones to null? If you did - then all of them are one of the internal types we still have hanging - as today's list did not bring any surprise visitors. Annie 21:55, 14 February 2017 (UTC)

That's right, "undefined" is no more! Ahasuerus 22:26, 14 February 2017 (UTC)
So internal ones only - I do wonder if most/all were not parents or something. Oh well - not that it matters if they never show up again. And I see that Italian finally pulled in front of the unassigned. :) Annie 22:32, 14 February 2017 (UTC)

2017-02-02 downtime - 5pm

The server will be unavailable between 5pm and 5:03pm server time. Ahasuerus 21:23, 2 February 2017 (UTC)

The server is back up. Ahasuerus 22:01, 2 February 2017 (UTC)

Verified pubs without story lengths

This is not addressed to any one person... As I have been going through double-checking 2016 short fiction, I have been finding numerous (several dozen) anthologies and magazine issues marked "primary verified" which do not have the lengths of the stories indicated. That seems like a problem. Personally I would never mark a publication verified unless I had determined the story lengths. --Vasha 01:28, 3 February 2017 (UTC)

Well, ideally all verified publications would have "length" values assigned. However, determining accurate word counts can be a time-consuming process due to different fonts, different page layouts, borderline cases, etc. If a potential primary verifier has the time to verify everything else about the pub but not each story's length, it may be better to have a primary verification on file even without the length values. Ahasuerus 01:48, 3 February 2017 (UTC)
I agree that print books are a real headache-- I have spent way more time than I wanted to painstakingly counting in those. For ebooks, you have to know how to use Calibre or some such program in order to count. But at least there is no excuse for not cutting-and-pasting online stories into a word counting app!
Maybe someone could chime in with some tips for how to get word counts from ebooks in various formats? --Vasha 01:53, 3 February 2017 (UTC)
If I have the book and I am not sure at the lengths, I would still verify it and then try to figure out lengths if I can after that. Some people verify without even adding content so your mileage may vary. :) The verification says "I have the book/magazine" so if someone needs clarifications, I can pull it out and answer questions. As for the e-books and sizes - depends on the publications - a LOT of them add number of words in their stories (good people); in other cases once you know the number of words of one of the story, you can figure out the rest based on kindle pages (for example). And sometimes just sending a note to a publisher or an author will get you that one example to allow to untangle the rest. Annie 02:32, 3 February 2017 (UTC)

Note that as per this discussion, some caution on the subject must be in order so any excess of zeal must be avoided. Hauck 07:21, 3 February 2017 (UTC)

Add Gender to Author Edit?

I think things have cooled off enough to return to the subject of adding gender identification to the author edit. Hopefully we can have a calm discussion and a straight up/down vote on it.--Rkihara 19:35, 3 February 2017 (UTC)

I'd say that it will be useful to have it as long as in addition to the standard two, we also have N/A (for pseudonyms and the like) and a category for the cases where someone is shifting or not declaring or whatever other reason for not knowing it (LibraryThing uses "other/contested/unknown" for example for this case) which is different from the value when no gender had been selected yet. Plus a policy about what the genre of an author should be set to if they changed it in their lifetime so we do not end up in a constant editing mode when editors disagree :) Annie 19:42, 3 February 2017 (UTC)
I am not seeing why this would be a particularly useful addition, actually. Yeah, sometimes people want to look up only stories by women or nonbinary people or whatever, but there are other sources for that. Having to figure out what gender people prefer to be referred to as, or figure out if they've changed, can be a headache. More importantly, if you get it wrong, people feel it as a personal insult, more so than if you get other biographical data wrong! --Vasha 20:17, 3 February 2017 (UTC)
Some of these issues were discussed back in 2013, but the discussion became too heated and then petered out for lack of consensus. Ahasuerus 20:34, 3 February 2017 (UTC)
So are you against adding gender to the DB at all or against allowing gender to be set to something different than male/female for a person? If the latter, how do you propose to assign gender in non-binary cases? Annie 20:22, 3 February 2017 (UTC)
No, I actually like having it not specified now. Yes, we should either list the exact gender that the person gives for themself or just neither of the above if we implement it. But I think the risk of getting it wrong is great, and the usefulness less by comparison.
If we don't change the gender listed on a trans person's page it will seem like a refusal to recognize them, even if it's only the result of slowness. We already had a discussion where people didn't want to change a trans person's name until they had been using the new name for "a while" however long that was. Will the same apply to gender? --Vasha 20:36, 3 February 2017 (UTC)
That was a discussion of an author's canonical name, not a legal name. Canonical names are "the most recognized name for that author. The canonical name may be a pseudonym". For this reason our canonical name for Alice Sheldon is "James Tiptree, Jr." Ahasuerus 20:59, 3 February 2017 (UTC)
OK fair enough, but there's still the headache of figuring out what gender people prefer. As I say, I'm against adding it at all, but I think that if we do, there should be a standard saying that it should not be specified on a living author's page unless determined from the author's website, a recent self-contributed bio, or some such. --Vasha 21:08, 3 February 2017 (UTC)
Let me quote something that I wrote during the last iteration of this discussion:
  • When choosing new fields for a record, I consider a few factors. Fist of all, the data, if known, must be unambiguous. One could argue that the place where a person was "raised" is more important than the place where he or she was born -- and many authors list the former rather than the latter in their autobiographies -- but it's too nebulous for us to use because in many cases there is more than one location.
  • The second factor is relevance, e.g. DOB and DOD are relevant because they show when the author worked, help identify posthumous books, inform the reader that no, there probably won't be a sequel, and so on.
  • The third factor is how easy it will be to find the information. For example, a few years ago I considered proposing that we add a "Place of Death" field to the Author record, but concluded that it would likely remain largely empty for lack of data.
If identifying gender becomes, as you write, "a headache" -- e.g. see this 2003 post by Poppy Z. Brite (who later changed the name to Billy Martin) -- then it affects the first and the third criteria and the proposed addition goes to the back of the line (in my mind.) Ahasuerus 21:24, 3 February 2017 (UTC)
Having a standard that the source of gender information must be the author themself would help make it unambiguous. Not quite as good as DOB which never changes. Aren't you phasing out the wiki pages? They're the natural place to put notes about sources of info. --Vasha 21:43, 3 February 2017 (UTC)
Not the ones for authors (yet). I am sure that when we decide to tackle those, there will be space in the DB for the data from them. Annie 22:06, 3 February 2017 (UTC)
That's right. Once we wrap up the migration of series-, publisher- and publication-related notes to the database proper, we will tackle "Biblio" and "Bio" pages. We still need to decide whether they will be migrated to a single "Note" field or whether we will have a separate field for "Biography" (where does "Son of Anne McCaffrey" go?). All "Note" fields support the {{BREAK}} syntax, so any supporting information will appear on a separate page. Ahasuerus 22:56, 3 February 2017 (UTC)
Im absolutely against this field's addition. My position is simple: the only person that can specify at a given time the gender of an individual is solely him/her/itself and no-one else. As we can't guarantee this, we should not provide this data regardless of the bibliographic benefits that may derived from it.Hauck 10:01, 4 February 2017 (UTC)
I think it would be a useful addition. For authors who were born gender A and then legally changed it to gender B, we'll have to decide whether we should enter the last known gender like we do with legal names. Ahasuerus 20:23, 3 February 2017 (UTC)
Leaning on legal changes is not good practice when it comes to trans people. They can transition and live as their preferred gender long, long before the paperwork is straightened out (if it ever is). You just have to list a person's gender as what they say it is. --Vasha 20:46, 3 February 2017 (UTC)
That's another interesting question. The last time it came up, Darrah mentioned some of the difficulties involved:
  • There are some author databases that keep track of gender (e.g. LibraryThing), and at least some of them distinguish between "male" and "presumed male". The question becomes, how much do we need to know about them before we assign them a gender? Do we have to have seen them? (Is that good enough?) Do we have to have a reasonably authoritative reference that uses a gendered pronoun for them? Can we assume someone named "Susan" is female? As a gender researcher, I also would like to see this data in the database. (So far, when I've identified a non-obvious gender identity, I've made sure to add something to the author's wiki bio age that includes a gendered pronoun.) But to add this feature (which I support), we need to decide what rules apply when we specify a gender as "known".
Ahasuerus 21:06, 3 February 2017 (UTC)
Thanks for that! --Vasha 21:10, 3 February 2017 (UTC)
The issue of joint/house pseudonyms is an interesting one and I don't think it has come up before. Obviously, something like Editors of Chicago Tribune would have to be "N/A". However, we'd have to decide what to do about The Brothers Grimm, Ilona Andrews (a husband and wife team), and house names all of whose authors are/were of the same gender. My first reaction is that it's safer to use "N/A" for all pseudonyms due to their shifting nature. Either way, it shouldn't stop us from implementing gender support. Ahasuerus 20:23, 3 February 2017 (UTC)
I wouldn't think this to be a useful addition, too. Gender can be a theme in some works, and though there may be a dominancy in some author's work, I'd think it would serve more towards to put an author into a certain basket, obscuring the many other facets the author's works may show (and should, if the work is more than one-dimensional). I'd think that the tag function is enough to mark the works of gender interest. (I am aware that it is a biographical marking rather than a bibliographical one but people tend to confuse those things; also, we than also could - or should? - index if an author is married or lives in a stable relationship, has children, his major occupation could be of interest etc.) Stonecreek 10:35, 4 February 2017 (UTC)
Also, I fear that there wiil be some rush to assign gender to every author's entry, culminating into many false or questionable edits (similar to some of the novelizations markings we had: there were some that are part of a movie or tv series universe, but weren't novelizations of any film). Stonecreek 10:43, 4 February 2017 (UTC)
I imagine it would be moderately useful, if and only if there were a foolproof way of adding the data. As there obviously isn't, and as this would raise too many problems, I think it is not really worth the trouble. Linguist 15:47, 4 February 2017 (UTC).
Most bibliographies such as Austlit and Gale do list gender, and we already list info that is irrelevant to a purely bibliographical listing: DOB, DOD, Birthplace, Art, Artist, Interior Illustrations, etc.... There is no foolproof way to enter "any" data into the database, errors of gender should be no more common than errors of language, or DOB/DOD and Birthplace. The ISFDB is being more widely used as a research tool and gender information is useful in a lot of research. I solicited comment from Eric Leif Davin, author of Partners in Wonder, on the value of gender identification when I first proposed this. Unfortunately, this seemed to throw more fuel on the fire.
I have a personal interest in this, since I feel female writers bring a sensibility to the genre that most male writers lack. I know that Chavey is interested from an academic standpoint.--Rkihara 18:32, 4 February 2017 (UTC)
I appreciate Ahaseuras quoting my concerns about the challenges this would lead to from our previous discussion. I have recently been involved in a couple of Wikipedia edit wars over a person's gender, including one editor who insisted that Charlie Jane Anders should be listed as male, because they had found an (old) posting in which she referred to herself as male. Those two edit wars make me a little more skittish about assigning gender, at least for living authors. If we did include "gender", I think we would need to have a mandatory field for the source of that info. What would we accept as sufficient justification? "They use an obviously male name"? "I've seen them at a convention, and they were obviously female"? "I found an online post where they refer to themselves as male"? "I heard them talk about transition to female, so they must be female now." In each of these cases, I know counter-examples. Rkihara suggests that it's ok to have some mistakes in the database, but I don't think current authors will get as annoyed at us over an error on their date of birth, or being confused about assigning their "Richard Smith" art to the wrong "Richard Smith". Getting someone's gender wrong will, something like 50% of the time, get that person angry. And I think we should try to avoid that. So, while I previously supported the idea of including gender info, I think now that I can only support Vasha's suggestion about limiting gender information to deceased authors. And that would have to be enforced by the software. Chavey 19:50, 4 February 2017 (UTC)
Agreed, because while an individual or team can gather information according to whatever standards they think is right, a crowd-sourced project like this one is bound to run into trouble. That's how this DB differs from other bibliographies. --Vasha 15:18, 5 February 2017 (UTC)
I agree that it's good idea to list the source of a gender assignment, but I feel restricting it to dead authors is a little too restrictive. I think that Chavey's estimate that 50% of people would be upset if we misidentified their gender is way too high. I think that most would be upset only if we refused to correct their gender identification when notified. Authors who use initials for their given names are probably used to this. People that are trans or self-identify as another gender are aware that it takes a while for this to be widely known, and would probably be glad to see this information more widely disseminated.--Rkihara 21:10, 5 February 2017 (UTC)

(unindent) Given the variety of opinions on this subject, reaching consensus may be difficult. Still, let me suggest a slightly different approach, which may, with luck, alleviate some of the concerns. How about the following values for the proposed drop-down list:

  • Blank (default)
  • Female
  • Male
  • N/A (joint pseudonyms, house names, etc)
  • "See Note"

Since our underlying standard for author fields is "publicly available information", we could put whatever information is available publicly in the Note field and make it as detailed as necessary. Of course, we'll have to add support for author-specific notes first. Ahasuerus 21:54, 5 February 2017 (UTC)

Publicly available when and where - is Wikipedia enough at the time it is added to the DB here? And which DBs update their records properly so we can rely on them for verification? Will all the moderators take it upon themselves to verify every attempt to change the gender before approving? What happens in 10 years when someone changes a gender? Who is going to bring the data uptodate when someone changes their gender 5 years after theirs is assigned here? And I am worried about new editors, not reading through the rules for gender and deciding to help by assigning genders on all authors they have books from. The more I think about it, the more it feels like Pandora's box and I would rather not have it in the record than deal with the possible issues... Annie 03:02, 6 February 2017 (UTC)
Still strongly opposed to this idea. Hauck 08:18, 6 February 2017 (UTC)
If it's a straight up/down vote, I'd say no. If you want a single reason - we've got enough to do filling gaps rather than creating new ones. Doug H 13:50, 9 February 2017 (UTC)

(unident) Outcome: Consensus not reached. An FR will not be created. Ahasuerus 18:40, 17 February 2017 (UTC)

2017-02-03 server downtime - 3pm

The server will be unavailable between 3pm and 3:02pm server time. Ahasuerus 19:41, 3 February 2017 (UTC)

Everything is back up. Ahasuerus 20:02, 3 February 2017 (UTC)

Bill Longley

Raising a glass to 'our' Bill Longley, who died three years ago today. We're carrying on with the good work, Bill! PeteYoung 05:19, 5 February 2017 (UTC)

Cheers! (I miss him.) Chavey 09:06, 5 February 2017 (UTC)
Me too: I wouldn't be as much involved hadn't he shown his loads of encouragement and good humour. Stonecreek 09:59, 5 February 2017 (UTC)
Ars longa, vita brevis... Ahasuerus 17:31, 5 February 2017 (UTC)
I had been meeting him virtually a lot the last few weeks while I had been transferring wiki data to the DB. Haven't realized that he is not with us anymore :( Annie 03:05, 6 February 2017 (UTC)
Cheers! Miss you! Rudam 10:27, 6 February 2017 (UTC)

2017-02-06 downtime - 12 noon

The server will be unavailable between 12 noon and 12:02pm server time. Ahasuerus 16:41, 6 February 2017 (UTC)

The server is back up. Ahasuerus 17:02, 6 February 2017 (UTC)

2017-02-08 server downtime - 1:40pm

The server will be unavailable between 1:40pm and 1:42pm server time. Ahasuerus 18:23, 8 February 2017 (UTC)

Everything should be back up. Ahasuerus 18:42, 8 February 2017 (UTC)

Two different John L. Campbell?

Can someone look at John L. Campbell? I am pretty sure that we are dealing with two different people with the same name but will appreciate a second set of eyes. The author data belongs to the novelist from the 21st century. Annie 19:31, 8 February 2017 (UTC)

I'd say you're right. The photo on the website link belongs to a guy who is 40 years at most, likely younger. Presuming that it is from the 2010s he can't be the one who published stories in the Sixties. Stonecreek 19:44, 8 February 2017 (UTC)
Yeah and he does not claim the stories anywhere on the site either. Or anywhere else. Is that enough to get a disambiguation going? Annie 19:51, 8 February 2017 (UTC)
I'd say so! Good catch! Stonecreek 19:52, 8 February 2017 (UTC)
I've submitted the change in the authors for the two old stories (I think I got it anyway...). There is always a first time for everything. :) Annie 21:29, 8 February 2017 (UTC)

2017-02-09 server downtime at 1:15pm

The server will be unavailable between 1:15pm and 1:17pm server time. Ahasuerus 18:02, 9 February 2017 (UTC)

The server is back up. Ahasuerus 18:16, 9 February 2017 (UTC)

Author formatting?

I believe I have removed all extra spaces between author names. However, there is another discrepancy which we may want to address. Some of our pages separate co-author/co-editor names using commas while other pages use "and"s. For example, this publication page says:

  • Editors: C. L. Werner, Steve Lyons, Rob Sanders, Ben Counter

but the associated title page says:

  • Editors: Ben Counter and Rob Sanders and Steve Lyons and C. L. Werner

I think it would be desirable to use the same separator throughout the site. Personally, I prefer commas to "and"s. Ahasuerus 21:11, 9 February 2017 (UTC)

Good point. And yes, I think commas look better too.
Another suggestion: should the category "Shortfiction" on author summary pages be "Short Fiction"? --Vasha 21:55, 9 February 2017 (UTC)
I like the and on the author pages (being in bold and with the long enough string to split the authors)- it gives me an easy split in the long chain of names on some of the titles and makes the page easier to read. At the same time, I prefer the comma on publications and title pages. Annie 22:46, 9 February 2017 (UTC)
Agree with Annie on that, and also in tables of contents the and is good. --Vasha 14:36, 11 February 2017 (UTC)

2017-02-10 server downtime at 1:45pm

The server will be unavailable between 1:45pm and 1:47pm server time. Ahasuerus 18:30, 10 February 2017 (UTC)

Everything is back up. Ahasuerus 18:46, 10 February 2017 (UTC)

Changing the main search box?

As per feedback from an MIT librarian, the default search box, which requires the user to select a value from a drop-down list, may be sub-optimal. He proposed creating separate boxes for authors, fiction titles and series since they are the most common types of searches. I have seen similar comments on Usenet, so I am posting it here to see if there is broader support for this proposal. Ahasuerus 22:11, 10 February 2017 (UTC)

As an editor, I'm always having to scroll down to get to the Editing Tools (more so on publication pages due to the Other Sites - I have most turned off, but like to keep a few). I'd hate to see those even further down because the search box is now bigger. But I'd also like the convenience of making those searches easier. Maybe it's time for a whole revamp of the left menu? Have different menu layouts for logged in and non logged in viewers? If logged in, move the Editing Tools further up? -- JLaTondre (talk) 22:28, 10 February 2017 (UTC)
What JLaTondre said - more boxes at the top will make it even harder for editing. Plus - I seem to be doing a lot of searching for ISBNs - especially when I am adding so I would vote for that being somewhat more visible as well... I wonder if two different left bars (editing/browsing) controlled by a user preference and a switch at the top are not in order (so logged in users that are mainly searching do not see the editing either)... Annie 00:17, 11 February 2017 (UTC)
Well, we have FR 345, which reads:
  • Convert the Navigation Bar [on the left] to drop-down menus across the top of each page.
I was a bit shaky on the technical side when I created the FR in 2012, but I think I can do it now. My recovery is progressing slower than expected, so more demanding/larger projects are currently on the back burner anyway.
A less drastic change would be to move the "3 by 5 catalog card" image to the top of the page, which will free up additional real estate within the search box. Ahasuerus 01:45, 11 February 2017 (UTC)
If we are going to change that menu anyway, any chance to have the Editing tools on a publication a bit higher ( see Dark Star - the "Other sites" box is a great thing (for someone I guess anyway) but it is in the way a lot... Annie 01:58, 11 February 2017 (UTC)
Three responses:
  • I say yes, if it's possible to have different menu bars logged in or not, the editing tools should be above the other sites.
  • I am pondering the idea of dropdown menus at the top, and I think, on the whole, I don't like it. I think it would greatly slow down access for things that I click on a zillion times while editing.
  • If you must have preset boxes for multiple categories, maybe just name and fiction title? Too many choices is confusing. I don't quite see how the design would work, with the search at the side, since the bar is too narrow to have labels next to the boxes.
--Vasha 07:08, 11 February 2017 (UTC)
I agree with the opinion that the LHS is already rather packed, and multiple search boxes would add to the clutter. A few observations/thoughts I have about the box:
  • Name is not obviously author name. (I realize "author" doesn't do justice to the nature of the possible roles). --MartyD 13:20, 11 February 2017 (UTC)
How about "Person"? Ahasuerus 19:16, 11 February 2017 (UTC)
In a Fiction DB? If I see "Person", I would think "character in a book". Author may not be exact but will not be confusing at least. Annie 19:40, 11 February 2017 (UTC)
  • I frequently do multiple searches for the same category of thing. If that's not Name, I have to (remember to) repeat the picking each time. Something that records my last choice (could be a cookie -- doesn't have to be in the DB; no preference management needed) and starts the drop-down out with that choice selected might help some searchers.
  • The flat list is sort of haphazard. If the items in there were grouped (e.g., title things, publication things, etc.), it might be possible to make a different layout that takes advantage of those groups, perhaps via tabs + checkboxes/radios, pull-rights, or some other sort of progressive disclosure.
Ideally, search would just look at everything and then tell the searcher about all categories of matches. Tough to do that efficiently in the current set-up. --MartyD 13:20, 11 February 2017 (UTC)
It wouldn't be too hard to add a new type of regular search to cover "All" record types, where "All" would be defined as authors, titles, series, publishers, publication series, ISBNs, tags and awards. That's what Amazon, IMDB, MAL and many other popular databases do. We could then display the results either as page sections (a la IMDB and MAL) or as tabs.
However, as Marty suggested above, performance would be a concern. An author search on "heinlein" takes less than 0.1 second. A title search on "heinlein" takes approximately a second. An "All" search of all record types would probably take under 2 seconds. (That's assuming that we make the search smart enough to identify search strings that look like ISBNs and handle them differently.) Is it an acceptable trade-off? I guess we could create a User Preference to control whether "All" is the default selection in the regular search box. Ahasuerus 19:36, 11 February 2017 (UTC)
Personally, I like the search bar. It gives more options, and takes up less space. It's essentially the same as the Amazon search bar. (Hence it's something users are familiar with.) I prefer Amazon's listing of the categories on the left better than IMDB's listing it on the right, but I prefer IMDB's organization of the results better. Chavey 13:43, 11 February 2017 (UTC)

(unindent) I agree that scrolling is a pain when editing records. How about an alternative approach? The most popular action when a logged-in user is viewing an ISFDB record is "Edit [record]". We already display the ISFDB record number on the first line of each page, e.g.:

Publication: Grave Markers: Volume Two         ISFDB Publication Record # 604827

How about adding an "Edit" link to the right of the number if you are logged in? And perhaps dropping the word "ISFDB" since it's redundant? The same line would then look as follows:

Publication: Grave Markers: Volume Two         Publication Record # 604827 [Edit]

Would that make life easier? Ahasuerus 18:15, 11 February 2017 (UTC)

YES! That would be awesome. Annie 19:37, 11 February 2017 (UTC)
Very good idea. --Vasha 21:56, 11 February 2017 (UTC)
Very much like the idea of having an edit link there.
One of my personal issues with search is that I frequently accidentally perform the wrong type of search because of the trackpad on my laptop, and then have to type and select my search all over again. It would be great if when a search returned zero results, there was a way to automatically re-submit the search as a different type. Aside from the "A search for 'xxxxx' found 0 matches" notification, there's nothing else on the screen, so there should be plenty of screen real estate to work with. Albinoflea 03:39, 13 February 2017 (UTC)
How about re-displaying the search string in the search box when you land on the "search results" page? That way you could select the correct value from the drop-down list and resubmit the search without having to re-type the search string. Ahasuerus 04:35, 13 February 2017 (UTC)
I'd love that. Annie 04:49, 13 February 2017 (UTC)
Likewise. Albinoflea 21:59, 14 February 2017 (UTC)

DC Metaverse/Sandman Cleanup

This series, this pub, this title, this series, this title and this title are all interrelated and should be part of a common series. I would recommend " The Dreaming" to match this link. The Sandman and Books of Magic should remain as part of that series. Death should have her own series with this title and this title. How would I go about getting this resolved? TAWeiss 19:55, 12 February 2017 (UTC)

I have added the titles that you listed (plus the Sandman series) to The Dreaming series. I have also turned it into a sub-series of DC Comics Metaverse. Could you please check the results to make sure that everything looks OK? Ahasuerus 19:22, 13 February 2017 (UTC)
Death of the Endless series which includes this title and this title should also be part of the DC Metaverse. TAWeiss 22:51, 26 February 2017 (UTC)
Done! Ahasuerus 23:25, 26 February 2017 (UTC)

2017-02-13 server downtime at 2:15pm

The server will be unavailable between 2:15pm and 2:17pm server time. Ahasuerus 19:10, 13 February 2017 (UTC)

Everything is back up. Ahasuerus 19:17, 13 February 2017 (UTC)

Kim Stanley Robinson's Mars Trilogy

I'd like to propose a change of the name for the series, from Mars Trilogy to Mars (Kim Stanley Robinson). The reason for this is that this ain't a trilogy no more, since it was expanded by a collection and diverse short pieces. If there are any objections or ideas for a better name, please let me know. Christian Stonecreek 18:57, 14 February 2017 (UTC)

It is kinda the accepted name, despite it not being a trilogy though. If I come to look for the series, I would type Mars Trilogy. So I would not be very happy to lose the name from our listings. Annie 19:26, 14 February 2017 (UTC)
Yeah... I agree with Annie, it is still most frequently referred to as the Mars Trilogy when it is discussed and written about... in fact, of his three trilogies this is the one with the least amount of confusion over its name.
As for the collection The Martians, which in one edition or another collects all of the short pieces that aren't just excerpts from the novels, most of them don't relate to the main Trilogy story; many are set in a totally different timeline (e.g. Exploring Fossil Canyon, Green Mars (novella), A Martian Romance) or an alternate timeline with the same characters (e.g. Michel in Antarctica, etc.)... the way I usually like to think of it, if the Mars Trilogy was a DVD, The Martians would essentially be the DVD extras portion of the disc. Albinoflea 20:03, 14 February 2017 (UTC)
You are right with the collection, but should it be part of the series in the first place? A collection consisting of six pieces from Ray Bradbury's Martian Chronicles and seven other pieces wouldn't be considered as part of the series either. Stonecreek 20:26, 14 February 2017 (UTC)
That's an interesting question... the collection was assigned as part of the Trilogy before I started editing here, and I've always taken it for granted. Advertisements and interviews from around the time it was completed frequently list it as "a companion volume" to the Mars Trilogy... the NY Times called it "a series of variations on the grand theme of the trilogy". Whatever it is, it's an edge case. Albinoflea 21:25, 14 February 2017 (UTC)
Perhaps this collection -- as well stories like "Michel in Antarctica" -- could be put in a "Mars Trilogy Metaverse", which would also include the original Mars Trilogy as a sub-series? Ahasuerus 21:48, 14 February 2017 (UTC)

2017-02-14 server downtime - 5:40pm

The server will be unavailable between 5:40pm and 5:42pm server time. Ahasuerus 22:29, 14 February 2017 (UTC)

Everything is back up. Ahasuerus 22:41, 14 February 2017 (UTC)

People relationships

There are some authors and artists that are related to others (Anne and Todd McCaffrey, J.R.R. and Christopher Tolkien, for example). Would it be a useful or desired feature to have a bio field where that relationship could be indicated? Perhaps, when editing a person's entry, have a field to enter the name/ID of the person to whom they are related, and then a drop-down for what that relationship is (parent, sibling, child, spouse, etc.)

Thoughts? ···日本穣 · 投稿 · Talk to Nihonjoe 01:27, 15 February 2017 (UTC)

At this time author-specific biographical and bibliographical information is recorded in the Wiki, e.g. see Nicolaus Bornhorn's Summary page which links to his Wiki-based Bio page.
There is a Feature Request to "Move "Author" and "Bio" pages from the Wiki to the database". I plan to implement it once we finish migrating all publisher-, publication- and series/magazine-specific pages to the database. We will need to decide whether we want to have two author fields -- one for biographical data and the other one for bibliographical data -- or whether we want to use just one "Note" field. Ahasuerus 01:38, 15 February 2017 (UTC)

Search tweaks

The search box has been changed to keep the entered search value when displaying the search results page. For example, if you do a search on "farewell," and forget to change the search type from "Name" to "Fiction Titles", the resulting empty search results page will re-display "farewell," in the search box.

We can also change the software to preserve the last search type if it is deemed desirable. Opinions? Ahasuerus 21:50, 15 February 2017 (UTC)

I'd love that. This way if the search failure is because of a typo (or because of non-Latin capitalization issue), I can change a single letter and try again immediately Annie 21:52, 15 February 2017 (UTC)
I love that, and I would love the "type" idea, too. ···日本穣 · 投稿 · Talk to Nihonjoe 22:56, 15 February 2017 (UTC)
Definitely, repeat last search type. --Vasha 23:47, 15 February 2017 (UTC)
Yes. --MartyD 13:36, 16 February 2017 (UTC)
Yes please. Albinoflea 16:58, 16 February 2017 (UTC)
The ayes have it! The software has been modified to remember the last search type.
P.S. Please note that these changes affect the search results page only. If a search finds a single matching record, the software will automatically redirect you to that record's page. If that happens, the last entered search value/type will not be preserved. Ahasuerus 18:04, 16 February 2017 (UTC)
A little fix needed - when you search for a non-Latin name, when you go to the next page, instead of the name, you have the codes of the characters. Search for "вежинов" (with the small letter). I would like to be able to just change the first letter to capital to search again but you cannot really do that (short of knowing the codes of course). Same happens with Japanese characters (and anythinh non-Latin1 I suspect (you can use 之 to see it with a Japanese character)Annie 00:13, 28 February 2017 (UTC)
Thanks, I'll take a look. Ahasuerus 00:21, 28 February 2017 (UTC)
OK, I think I got it now -- too much escaping is a bad thing! Ahasuerus 00:39, 28 February 2017 (UTC)
Confirmed for the regular ones. But there is an issue with finding this title. Thanks! :) Annie 00:52, 28 February 2017 (UTC)
Well, the problem with this title is that it's actually "& & # x 2 3 ; x 2 5 C D ;" (spaces added to defeat HTML). If you search for this exact string, you will find the record, but, of course, that's not something a regular user would think of doing. I am not sure we can fully support these "fake HTML" cases until we convert everything to Unicode. Ahasuerus 01:39, 28 February 2017 (UTC)
Suspected as much - just could not resist trying that one. Thanks for checking! Annie 01:45, 28 February 2017 (UTC)

"Edit" links added to all biblio pages

Based on the outcome of this discussion, "[Edit]" links have been added to all bibliographic (author, title, publisher, series, publication series, publication) pages. The only exception is the three award pages (award, award type, and award category) which do not display ISFDB record numbers at this time. Ahasuerus 21:29, 16 February 2017 (UTC)

Awesome! Thanks for the quick fix:) Annie 21:59, 16 February 2017 (UTC)

Stoker preliminary nominees to be added

I've added Award records for most of the Stoker preliminary ballot, but have decided to leave it to someone else to add the last of the nominated works that aren't yet in the DB. Here they are:

  • NOVEL (Superior Achievement in a First Novel): The Monster Underneath by Matthew Franks; Until Death by Kari Kilgore; The Sanguinarian ID by L. M. Labat; The Black Goat Motorcycle Club by Jason Murphy; Wasteland Gods by Jonathan Woodrow; The Eighth by Stephanie Wytovich
  • NOVEL (Superior Achievement in a Young Adult Novel): Keep Away from Psycho Joe by Michael Brent Kelley
  • NONFICTION (Superior Achievement in Non-Fiction): Haunted: On Ghosts, Witches, Vampires, Zombies and Other Monsters of the Natural and Supernatural by Leo Braudy; A Season with the Witch by J. W. Ocker; Guillermo del Toro’s “The Devil’s Backbone” and “Pan’s Labyrinth”: Studies in the Horror Film by Danel P. Olson; The Turn to Gruesomeness in American Horror Films, 1931-1936 by Jon Towlson
  • COLLECTION (Superior Achievement in a Poetry Collection): Brothel by Stephanie M. Wytovich; Small Spirits by Marge Simon; Two Drinks Away from Chaos by Aurelio Rico Lopez, III; Voices from Empty Rooms by Lisa Lepovetsky; Field Guide to the End of the World by Jeannine Hall Gailey; Children of God: Poems, Dreams, and Nightmares from the Family of God Cult by Craig DiLouie and Jonathan Moon; The Seven Yards of Sorrow by David E. Cowen; Corona Obscura: Poems Dark and Elemental by Michael R. Collings

--Vasha 20:46, 17 February 2017 (UTC)

All done. --Vasha 04:01, 24 February 2017 (UTC)

Weird pseudionyming

In this one, shouldn't Gregory Francis be pseudonymed under the canonical name and not under another pseudonym? Or am I missing a case where this is the way to do it? Annie 22:28, 17 February 2017 (UTC)

You are right, it's a joint pseudonym of two writers and should be "pseudonymed" to their canonical names. I have made the change. Thanks for spotting it! Ahasuerus 22:33, 17 February 2017 (UTC)
I would have fixed it - I just wanted to make sure we do not have an obscure rule for that somewhere :) I think the canonical name of this guy got shifted from the full name to the shorter one at some point or the two names were connected after the joined pseudonym was already in place without completely cleaning the field - I am cleaning a lot of leftover story variants as well for him. Annie 22:53, 17 February 2017 (UTC)

2017-02-17 server downtime

The server will be unavailable between 8:30pm and 8:32pm server time. Ahasuerus 01:17, 18 February 2017 (UTC)

Everything is back up. Ahasuerus 01:31, 18 February 2017 (UTC)

Language-less titles - the final push

Language-less ESSAY titles by first letter:

None. None at all.

Language-less INTERIORART titles by first letter:

| I    |      133 |
| J    |       36 |
| K    |       15 |
| L    |      138 |
| M    |      207 |
| N    |       93 |
| O    |      139 |
| P    |      195 |
| Q    |       25 |
| R    |      127 |
| S    |      445 |
| T    |     1865 |
| U    |       60 |
| V    |       32 |
| W    |      217 |
| X    |        2 |
| Y    |       13 |
| Z    |        6 |

Ahasuerus 21:05, 18 February 2017 (UTC)

All cover art entries are cleared. My pending queue has a few language assignments and a few unmerges (which will end up with new languages again). Once they are approved (and the language of the unmerges fixed), all remaining will be English :)
Essays A-H next? Annie 23:11, 19 February 2017 (UTC)
All relevant submissions have been approved. The first ESSAY batch will become available in the morning. Ahasuerus 00:29, 20 February 2017 (UTC)
Thanks! I just sent in the last batch of followups - after the unmerges. :) Annie 00:51, 20 February 2017 (UTC)
Looks good. I have auto-assigned the remaining COVERART titles, so we are down to ESSAYs and INTERIOART. Ahasuerus 02:09, 20 February 2017 (UTC)
A-H (plus special characters and numbers) essays are either English or in my pending list with a different language or for deletion ( a lot of them are for deletion). A-H (plus special characters and numbers) in Interior art next? Annie 04:06, 21 February 2017 (UTC)
Nice! INTERIORART/A-H coming up next. Ahasuerus 04:33, 21 February 2017 (UTC)
Thanks! With a bit of luck (and no work travel on my part), we should be done with assignments before the end of the month. :) Annie 05:34, 21 February 2017 (UTC)

(unindent) All Interior art records that start with A-H or special characters had been inspected and are neatly separated in 3 groups:

  • Group one - Legitimate non-English single titles - Title Edits submitted for all of those.
  • Group two - Mixed language versions - unmerge submitted for all
  • Group three - All of the rest - aka the majority - the English ones.

At this point it is safe to assign English to the whole group - and further update where needed will deal with it:

  • Group one - if the automatic language goes before my update, my update will fix the language; if my update goes first, the automation won't update this title (as it now has a language)
  • Group 2 - I have the log to work back through so setting these to English will not lose them (regardless if it happens before or after the unmerge) and will not cause any permanent issues (more titles added to the multi-language report is the side effect but I am clearing that one anyway)
  • Group 3 - all clear

All of the above explains why I was not that eager to deal with 5K of these on their own :)

So... next group please - Essays I-S? :) In the meantime I am dealing with the followups of the unmerges. If you want to wait for me to finish the followups, just add the new essays and leave the old interior arts in for tomorrow -- but making them English won't harm anything (as shown above). Thanks! Annie 23:09, 21 February 2017 (UTC)

Understood and thanks. All INTERIORART titles through H have been auto-assigned. The remaining ESSAYs will be making their triumphant appearance on the cleanup report by 1:30am server time. I can almost smell victory! :-) Ahasuerus 23:31, 21 February 2017 (UTC)
I will be happy to be done with this project - it had become a bit tedious in the last few batches (not enough to get me to stop so close to the end so no worries). Then I can go and kick some wiki entries out of the way again for a bit - does not seem like anyone is making any progress there. ;) Annie 23:41, 21 February 2017 (UTC)
Seems like the essays did not make it to the report tonight. :) oh well - tomorrow night then. Annie 07:06, 22 February 2017 (UTC)
So was it intentional or did just the report get a bit confused? Annie 17:51, 22 February 2017 (UTC)
Sorry, that was a snafu on my side. I had two patches almost ready to go, but only the first one was actually installed yesterday. All fixed now; the data will become available in the morning. (And yes, I can see how reviewing and fixing approximately 100,000 titles can get just a tad tedious ;-) Ahasuerus 18:02, 22 February 2017 (UTC)
No worries - figured out that either you never pushed it or messed up the filtering (I had been a bit creative on ranges in some types after all). Just wanted to make sure that there is no other reasons I am missing. I had not been counting how many I had been clearing - would not be surprised if it is close to 100 000 indeed. At least I did not send 99K or thereabouts "set to English" updates into the moderators' queue during the process - that would have caused a revolt. Annie 18:27, 22 February 2017 (UTC)
We had approximately 100,000 "bad" titles after the first, completely automated, round of auto-assignments. We are down to 6,000 as of this afternoon. Some auto-assigned titles were processed without a manual review, but my guess is that approximately half were reviewed. That's a lot of titles to eyeball! Ahasuerus 18:44, 22 February 2017 (UTC)
The automatic assignment of essays and stories starting with "The " did catch a few non-English by the way (stories and essays still unmerged from their English parents) - but they all popped up on the multi-language report so we are good there. And a lot of titles had weird languages - working through some of them had been fun. It could have been a lot worse - if we had a lot more international titles from the days when languages were not supported (or not mandatory or whatever the case was). Annie 19:07, 22 February 2017 (UTC)

(unindent) Two essays are waiting for their language in my pending list (one German, one French in the process of unmerging) and a few more German ones are trapped in two German non-fiction collections (I am leaving them there merged for now until we find the content so we do not end up doing triple work). Anything remaining is English. And we are officially done with the text titles. :) Next: the remaining Interior Art titles (all 3700 or so of them). Annie 20:40, 23 February 2017 (UTC)

Excellent! All eligible ESSAY titles have been auto-assigned and the remaining INTERIORART titles have been primed. I have also moved all language-specific title reports to the main "Title" section, but I should make a separate post about it in case things get lost here. Ahasuerus 00:13, 24 February 2017 (UTC)

(unindent) And done. I expect a few new titles to hit the multi-language report (I did not split a few because I saw more work to be done on their publications so I would rather see it on the other report and finalize them; anything that would not hit the report or does not need to is cleaned) but at this point all language-challenged titles that are not in my pending list can be assigned to English. And that means that the "To be Assigned" group lost the game and takes its rightful place at the end of the queue. It will take a few days to untangle some of the multi-language ones but outside of that the languages for titles cleanup project is officially finished. :) Annie 20:37, 27 February 2017 (UTC)

Fantastic (no pun intended)! Many thanks! Everything has been assigned, so the cleanup report should be, well, "clean" tomorrow. I am going to revert the change to the "Titles without Pubs" report next and post a note on the Moderator Noticeboard next. Ahasuerus 21:10, 27 February 2017 (UTC)
Yep. Thanks again for pulling the two types out of the report temporarily. Annie 21:15, 27 February 2017 (UTC)

Import coverart titles from publications?

Currently edit/importcontent.cgi (and presumably the .py too but I did not look at the source) allows one to import titles from another publication (i.e., so called "Option 1" which is nice improvement from before; I recall when there were no options but importing via a list of title numbers). That said, it does not seem to allow me to import coverart titles from one pub to another? Do we have a feature request for this? If not, can we get one? I did not test if edit/exportcontent.cgi would move covertart titles but I expect it won't (someone let me know if I am wrong). Thank you. Uzume 04:33, 19 February 2017 (UTC)

I think I have seen that already done (but you'd have to be careful when there's an already existing coverart title). If you just want the art transferred you only need to copy the address into the Image URL field. Stonecreek 11:52, 19 February 2017 (UTC)
The bulk import (Option 1) does not import the coverart. However, the individual import (Option 2) does allow you to import a coverart title. Option 1 already has a check box for including page numbers. A cover art check box could be added similar to the clone pub screen. -- JLaTondre (talk) 13:22, 19 February 2017 (UTC)
Yes, that makes a lot of sense, adding a checkbox if the cover artist is the same when bulk importing titles. --Vasha 14:37, 19 February 2017 (UTC)
Sounds like a good idea. If there are no objections, we can create an FR. Ahasuerus 15:55, 19 February 2017 (UTC)
Does the bulk import already bring over interior art? --Vasha 19:21, 19 February 2017 (UTC)
Yes, it does. We could add another check box for INTERIORART titles. Ahasuerus 19:28, 19 February 2017 (UTC)
Yes there should be for the same reason that Clone has it. (And the order of the boxes the same as Clone, no confusion.) --Vasha 20:38, 19 February 2017 (UTC)
If Clone has this I would consider this a bug (albeit minor) and not an FR. Uzume 00:54, 20 February 2017 (UTC)

(unindent) OK, FR 980 has been created. I don't think it's a bug since the current behavior is intended. Ahasuerus 02:14, 20 February 2017 (UTC)

The current behavior is intentionally different from clone behavior? Why? Uzume 03:06, 20 February 2017 (UTC)
Originally, there were no check-boxes. Then we added a "page numbers" check-box to the import process. Then we added an "intermediate" page with a couple of check-boxes to the cloning process. Then we added more check-boxes to the "intermediate" cloning page. Now we are considering adding more check-boxes to the Import/Export page. The fact that similar functionality is already available on the cloning side of things doesn't mean that there is a bug with the import/export software as it currently exists. Ahasuerus 15:49, 24 February 2017 (UTC)

Wiki sidebar tools

I just recently noticed (though it probably was true sometime back) that the left sidebar tools in the wiki are now at the bottom of the page past all the rest of the content. What I mean it is the sidebars labelled "navigation", "search" and "toolbox". This makes it very cumbersome to use these links on long pages (like this one for example but it is still true on short pages like the main page). I am using Chrome if that makes a difference. Has anyone else noticed this and have any feedback, comments, or solutions? Thanks. Uzume 16:39, 19 February 2017 (UTC)

I have tried it with Chrome, Firefox and IE. All three show the sidebar tools on the left. Have you tried clearing the cache and other browser detox tricks? Ahasuerus 16:51, 19 February 2017 (UTC)
I have this with Chrome too. It's also occurs in incognito mode with no extensions active so seems pretty clear it's a browser issue. It's been that way for awhile. Using the developer tools, I can see Chrome and Firefox parsing the <div> indents differently which causes the issue in Chrome. I suspect that the wiki software is probably doing something that isn't 100% standard and Chrome is no longer tolerating it. -- JLaTondre (talk) 01:53, 20 February 2017 (UTC)
I appreciate the response. I might have to look into that and see where things are going awry (we might be able to fix it in a template or some such). Uzume 02:46, 20 February 2017 (UTC)

Roadmap 2017

As of late, I have been tweaking the software based on user feedback and in support of various cleanup projects. It was a good match while I was recovering from the most recent unpleasantness over the last couple of months.

Going forward I hope to get back into more heavy-duty development work. With that in mind I have compiled a list of software projects that are currently close to the top of my list of priorities for 2017. I'd like to post them and solicit feedback re: their desirability and relative priority. If a description seems too vague or incomplete, please don't hesitate to ask for a clarification. Detailed suggestions/feedback re: individual FRs may need to be spun off as separate Community Portal sections. Additional requests welcome!

Continuation and further development of currently active projects

  • Language cleanup:
    • Assign languages to all titles
    • Assign languages to all authors. Should we use the manual approach that we used with titles? Or can we automate some parts of the process based on the language of each author’s titles?
      I think that for the ones remaining (with 3 titles or less), we can just assign automatic English if all the titles they have are English (after all titles have languages). We will miss a few that are not English but we will also miss a lot of them if we go manually - they will require a lot of research at this point. If a non-English title ever appears, we can always change it. That won't be much different to what will happen now if someone adds a magazine in English and do not change the author language manually after the addition... Annie 20:38, 19 February 2017 (UTC)
      Or if someone is too worried about doing it, going the manual way will always work of course. Annie 05:38, 21 February 2017 (UTC)
      I guess the "low-hanging fruit" would be identifying language-challenged pseudonyms of language-enabled authors and auto-assigning the parent author's language to the pseudonym. Ahasuerus 16:07, 21 February 2017 (UTC)
    • Yes, I think we even talked somewhere about that. If those can be done, this will eliminate a pretty good chunk of what is remaining... Annie 16:25, 21 February 2017 (UTC)
  • Wiki cleanup
    • Move series/magazine-, publisher- and publication-specific etc Wiki pages to the database
    • Move Bio and Bibliographic data to the database
Globally OK.Hauck 20:00, 19 February 2017 (UTC)
Along with this (though it might not qualify as part of your currently active projects), I would like to add, it would be very good to try and untangle the main DB from the wiki DB (particularly with respect to login credentials and sessions, etc.; I have a few ideas on this). This would facilitate upgrading our MediaWiki software which we are sorely behind on (including many security/bug fixes as well as features). Uzume 20:41, 19 February 2017 (UTC)
Unfortunately, my knowledge of the MediaWiki software is very limited. Last we talked about development, Al was going to look into this issue, but he has been unavailable for a long time. I could try and get myself up to speed, but, unfortunately, learning new things gets harder as you get older. Ahasuerus 16:18, 20 February 2017 (UTC)
It is already untangled in terms of sessions - I get asked to login in wiki while my session is fine on the site and vice versa. So it is just the users that are the same. Annie 05:38, 21 February 2017 (UTC)

New projects

  • Create a separate queue for automated submissions, which will enable non-moderators to work on them (and let me concentrate on development). Rather time-consuming to implement. Discission moved here.
  • Internationalization:
    • Support multiple prices per publication.
    • Support multiple publishers per publication. May require more thought re: imprints.
      I wonder if that cannot be solved in a different way - allow books published from a joint venture to show on 3 publisher pages - a combined one and the two separate publishers ones. Or if we go for multiple publisher, we should have a way to see which books are from both publishers at the same time without the need to compare lists manually Annie 20:52, 19 February 2017 (UTC)
      An interesting point. I have never considered it, but the proposed behavior seems desirable. We'll have to think of the best way to implement it. Ahasuerus 02:18, 20 February 2017 (UTC)
      And here comes a live example that I and KarenHunt had been investigating: Братья по оружию. It is a joint venture between the Moscow based Астрель and the Minsk based Харвест with separate ISBNs for both (9785271439186 for Астрель and 9789851815919 for Харвест) and usually all copies of the books carry both publishers and both ISBNs (I've had a few similar ones). If you create a fictitious "Астрель / Харвест" (incorrect it is not an imprint) or "Астрель & Харвест", it will remove the book from the two individual publishers' pages. Adding two separate copies (one per ISBN) is not exactly correct either as it is the same book (ha - this is one of the other projects below - multiple ISBNs). The cleanest seem to be to go for one of them and note the other in the notes. None of those scenarios are very good though. Annie 01:09, 25 February 2017 (UTC)
      And just to illustrate why it is a bad idea to use the double name, this wonderful example of Russian thought has 4 valid ISBNs on the same publication - it is again a joint venture between Харвест and this time another of the publishing group АСТ's imprints/daughter companies - this time Хранитель instead of Астрель. But just to make it funnier, it also got ISBN for the parent as well and an ISBN for the pure Moscow "АСТ Москва" which was consolidating their list. So we will need yet another joint version for this one. As you can imagine, there are more of those. :) Annie 01:25, 25 February 2017 (UTC)
      We had a discussion of Russian publishers a while back, which is what pushed this FR up the list of priorities. There are other publishers who use multiple ISBNs, but Russian language publishers account for the majority of our "problem cases". Ahasuerus 01:34, 25 February 2017 (UTC)
      Well - I saw an example, decided to post it so it is in the thread. Sorry if it was repeating already known data - I do not remember stumbling on this discussion when I was reading archives. Annie 01:52, 25 February 2017 (UTC)
      Not a problem at all! I was just sharing additional background information. Part of my job description :-) Ahasuerus 02:03, 25 February 2017 (UTC)
    • ISBNs (mostly to support internationalization, but will also help in other cases):
      • Support multiple ISBNs per publication
      • Move catalog IDs to a separate field, which will help with pubs that have both an ISBN and a catalog ID, e.g. book club publications.
      • Add two checkboxes next to each ISBN: “derived” and “corrected”. The latter will let us capture two versions of invalid ISBNs, the stated one and the corrected one. Discussion moved here.
    • Add support for translators (as well as other roles like single-author collection editors?) Discussion moved here.
    • Move “Add Authors/Transliterated Titles/etc” buttons to the right to free up screen real estate. This will become more important with the addition of new multiply occurring fields (see immediately above.)
    • Change “Family Name” to “Directory Entry”. If we allow multiple values to support different alphabets/scripts, how will we sort by this field? Discussion moved here.
    • Separate translations from VTs on the Title page. Allow users to limit the list of publications to the ones associated with the canonical title.
      Won't that also allow us to group same language translations? If not, then can we have that as well? I would love to be able to see that there are 30 different language translations without seeing that there are 10 French ones until I really want this information :) Annie 20:52, 19 February 2017 (UTC)
      I don't recall this functionality mentioned in the past. I would suggest creating a separate section to explain what you would like to see and to gauge other editors' reaction. Ahasuerus 16:23, 20 February 2017 (UTC)
      I'd like to see this one. -- JLaTondre (talk) 01:22, 20 February 2017 (UTC)
  • Re-do verifications. This will let us have more than 5 primary verifications as well as multiple transient verifications per publication.
    I'd also like to see this one. -- JLaTondre (talk) 01:22, 20 February 2017 (UTC)
  • Create a history of changes to primary-verified publications by storing a snapshot of the way each verified pub looked like right before it was changed.
  • Support for third party IDs (OCLC, BLIC, LCCN, BNF, ASIN, Goodreads, etc). This will enable Fixer to submit ebooks without ISBNs, an increasingly common scenario. Discussion moved here.
  • Make the Quick Tags list user-definable.
  • Add support for additional title types like PLAY and FICTITIOUS ESSAY (requires discussion to come up with additional values.) Discussion moved here.
  • Cleanup reports:
    • Make additional cleanup reports available to non-moderators
    • Review old/incomplete FRs for cleanup reports, add missing title types
  • Add a “non-genre” field to author records; create a cleanup report to find non-genre titles by non-genre authors. Discussion moved here.
  • Add a disambiguator field to title records (requires discussion)
    Don't understand. Hauck 20:08, 19 February 2017 (UTC)
    Is that for the ability to add the reason for the variant (change in name, change in author, translation, abridgement)? If so, I'd love this one. If not - What are talking about? Annie 20:52, 19 February 2017 (UTC)
    The problem that we are trying to address here is that some authors have identically named titles. For example, H. P. Lovecraft's Summary page shows three "The Lurking Fear and Other Stories" collections published in 1947, 1964 and 1971. They are all different, but you can't tell until you drill down to the title level and check each title's Note field. Similarly, there are 2 version of the story "The Rats in the Walls" (1924 and 1956), 4 "[To Albert A. Sandusky]" poems and 9 (sic!) poems whose title is currently entered as "[To ?]". Analogously, Clark Ashton Smith wrote 4 different "Ennui" poems, 2 different "A Sunset" poems, 3 "sonnet" poems, etc. A "disambiguator" field would be used to capture a brief summary of what's unique about each title, e.g. "1964 version", or perhaps the first line if it's a poem. It would be displayed on the author's Summary page. In addition, we will need to decide whether to use this field to capture other information like "abridged", "revised" or "greatly expanded". There were different suggestions the last time we talked about it. Ahasuerus 16:53, 20 February 2017 (UTC)

Ahasuerus 19:50, 19 February 2017 (UTC)

Additional Proposed Projects

  • Add a "printing rank" field to order multi-reprinted titles without pub dates.Hauck 19:57, 19 February 2017 (UTC)
    Yes, please! And not only for dateless - even if we know the dates, a field for edition and printing will be awesome (so if I have 2nd edition, 3rd printing, I can look for 2.3 or something like that and find it without looking through 200 publications). Annie 20:52, 19 February 2017 (UTC)
    There is a Feature request to "Add a 'printing' field to publication records". It would be relatively easy to implement, but we need to decide what kind of data we want to capture. Unfortunately, "editions" and even "printings" do not always follow the standard numbering scheme, so "2.3" won't work. For example, this 1989 edition of Heinlein's "Have Space Suit—Will Travel" says "First Ballantine Books Edition: December 1977 Thirteenth Printing: October 1989". On the other hand, this 2005 edition simply says "First Pocket Books trade paperback edition [no printing number]". This is very common, so you can't expect "editions" to be sequentially numbered. We could limit this field to numeric printing numbers, but there can be any number of "first printings" from different publishers. It doesn't mean that we won't want to implement this field, but we need to understand its limitations. Ahasuerus 04:07, 20 February 2017 (UTC)
    The 2.3 was mostly an oversimplification for the multiple printing scenarios - not necessary requesting it to be numbers only. But we do need some guidelines for formatting in that field - or we will end up with unsearchable field. It will still be better than the current way to find where we are. Even if it is just printing in the field - the edition is kinda clear from the ISBN unless if it gets reused. Annie 04:13, 20 February 2017 (UTC)
    What!? I cannot put Chinese characters in the printing field? But I know of some publishers that mark their printing this way (OK, I am facetiously joking but it is true). Uzume 04:58, 20 February 2017 (UTC)
  • Add a new title type for excerpts, and one for plays/scripts. Neither of those fit nicely in SHORTFICTION. --Vasha 21:02, 19 February 2017 (UTC)
  • Another useful feature, mainly for links from external site to the ISFDB: stable IDs. Currently, if a title is merged into another its ID ceases to exist in the database. As a result, links from external sites to such a title record will become broken links. The software should instead keep track of merged IDs and redirect to the new ID (there was a discussion about this some time ago but I just couldn't find it). Jens Hitspacebar 21:10, 19 February 2017 (UTC)
  • [Discussion of third party IDs moved here.]
    1. The next item I would like to see is revamping verifications. I am not sure how valuable it is but it has plagued us for a while now. Uzume 21:36, 19 February 2017 (UTC)
    2. Finally, author and publisher directory updates seems like a good item. This could bed sooner but probably will be easier after more internationalization/localization is completed so doing it a bit later might prove less problematic. Uzume 21:36, 19 February 2017 (UTC)
  • There had been some discussion about reviews of magazines here. I think the discussion petered out rather than concluded, but did get into alternate ways of dealing with magazine series. I'm not pushing for it, just reminding. Doug H 21:59, 19 February 2017 (UTC)

Editor review of submissions: "automated" submissions sidebar

Create a separate queue for automated submissions, which will enable non-moderators to work on them (and let me concentrate on development). Rather time-consuming to implement. Ahasuerus 00:10, 20 February 2017 (UTC)

Yes, please :) I know that it is a time consuming change and so on but it should help in the long run... Annie 20:52, 19 February 2017 (UTC)
I am for editor review of submissions (by Fixer, etc.), however I question the need for a separate queue. Uzume 23:02, 19 February 2017 (UTC)

(unindent)I have some reservations about "automated submissions" (but that maybe based on my lack of understanding) referred to above in #Roadmap 2017. Why do we need another submission type like this? It seems to me this FR is just to allow editor reviews of submissions (like a voting system to help moderators close pre-reviewed submissions). Is there some reason some submissions should not allow editor review? Uzume 21:45, 19 February 2017 (UTC)

Because at the moment Ahasuerus is doing all of them. This is the process by which all newly published books are added to the system - so we do not wait for people that have them to add them. The idea is to allow the queues that the automated robot finds to be worked on by other people as well - which includes verifying that it is indeed eligible, cleaning the record based on our standard and so on. It is not about approval of entries from people, it is about adding the entries in the DB so the moderators can approve them. Annie 21:50, 19 February 2017 (UTC)
I do not see a difference with this. It is true bot generated submissions maybe of lower quality but then so are submissions from new users. I do not think we need a new field specifying the origin of the submission. I like the editor review of submissions concept (perhaps with comments and queued results to be approved by moderators). In the general sense, consistent high volume and high quality editor reviews of submissions could be a very good way of selecting prospective new moderators. Uzume 21:55, 19 February 2017 (UTC)
We do not have real bot submissions now - Fixer is manually operated by Ahasuerus, title by title, every month. That idea is to allow these queues to be processed by other people as well. Annie 22:03, 19 February 2017 (UTC)
I understand he is doing significant manual work on his side of bot before making submissions and to lighten his load, we want to be able to have his bot make lower quality submissions with better review from our community (instead of just him) and I agree with and would not argue on that point. However, it seems to me a generalized editor submission review process is a better solution than a one targeted just at this problem (which adds unneeded extra levels and fields for such). Uzume 22:10, 19 February 2017 (UTC)
And how is that different from making more people moderators if there are people that can do reviews like that? :) Plus - the process of accepting edits is already slow, do you really want to add more layers? A new editor will get discouraged fast. Plus - that won't solve the issue with Fixer and the sumissions - no matter who reviews, they need to get into the system one way or another. If you want all that it finds to be just added and someone reject it if it is not genre and/or not eligible, that would add a lot more work on the moderators... A Fixer, non-massaged entry is missing series information, have (or can have) a weird spelling on author and publisher, title (Amazon adds a lot of junk there) and it may need to be merged somewhere. No matter how many layers of whatever we have, if those just get dumped into the regular queues, the real updates will get delayed with days until the pure deluge of those is dealt with. Annie 22:18, 19 February 2017 (UTC)
I never suggested making editor review mandatory—just generalized. I do not understand why the normal queues would cause delay. Submissions are not required to be moderated in any particular order (I understand there are order issue with regard to moderation however). Uzume 22:36, 19 February 2017 (UTC)
No but delaying a new contributor edit while we are dealing with internal ones is a bad idea. And if you have 12000 Fixer submissions in the regular queue, how will a moderator find a new one. And even if they can, working on those ratty ones will be a longer and more involved process than on user-created ones. Thus the separate queues and the ability to do something before they hit the moderators. :) Annie 23:13, 19 February 2017 (UTC)
That sounds to me more like better management of the current queue is needed not another queue. Make the submission queue searchable and a moderator can for example just say "I do not currently want to see submissions by Fixer" (or say any user with a bot flag; this list is not very long Special:Listusers/bot). Uzume 23:40, 19 February 2017 (UTC)
The main difference is allowing editing before submitting - allowing the entry to be cleaned up before it goes into the proper queue for approval. This is not something moderators can do now - they can only accept and then edit after that. If you are saying that moderators should be able to directly edit ANY submission before acceptance, then yes, better management is all that is needed. But I am not sure we really need that. Annie 23:45, 19 February 2017 (UTC)
OK, so you are saying you want a separate queue and allow reviewing editors to edit/transmute the submission as part of the review process? That would be very powerful but also extremely difficult to code (since submissions are actually only semi-structured XML documents). Uzume 00:39, 20 February 2017 (UTC)
Thus the comment above that it will be very complicated :) If you read the FR, this is what it describes. Annie 00:40, 20 February 2017 (UTC)
Maybe Annie means a tiered submission process where editors can review automated submissions converting them to normal submissions or some such. But then in my mind "automated" just means "I want editor review first". Uzume 22:02, 19 February 2017 (UTC)
Not really. The current automated process is; Fixer finds the titles (wonderful), Ahasuerus submits them to the DB (from his name or from Fixer's name). Anything with low priority just stays in the queues until someone gets to them. Or forever. It is not about magazines, it is really about what the robot finds and needs to be processed. And you do not want to add to the moderator load all the "cleanup" that is needed - there is a LOT of work to be done on those submissions. And just dumping them into the DB without cleanup, even with a flag will dilute and make the DB useless fast.Annie 22:09, 19 February 2017 (UTC)
I am not arguing against editor review for Fixer submissions. I am arguing this is more elegantly solved with a generalized process of editor review not specific to Fixer submissions. Uzume 22:13, 19 February 2017 (UTC)
Baby steps. Plus Fixer (and any other robots that can find more entries). It is not Fixer specific really - it is the ability to handle those kinds of submissions in a slightly different way. And I still argue that if a person does the submission, you do not need it to be delayed further. :) Annie 22:20, 19 February 2017 (UTC)
So you are saying the "automated" flag adds another tier delaying such submissions. I do not think that is necessary (and if you read the FR a moderator can directly moderated such without editor review anyway). The point is we do not need the flag can just implement generalized editor review of submissions. Uzume 22:35, 19 February 2017 (UTC)
If someone new does not understand the page, they may click it, sending the submission in a long(er) queue. What we need is a double queue - one that only moderators can deal with (the ones that had been seen by a human and just need the second set of eyes) and one for any "ratty" submission where more people can help with. Which is what this FR is for - allow a new process for submissions. Annie 23:09, 19 February 2017 (UTC)
I am all for editor review of submissions to help with such "ratty" submissions. I do not think we need another queue (chosen at submission time), just better management of the current queue should suffice.

OK, after some discussion...if we are talking about a totally different process where someone or something provides suggested changes (I am intentionally avoiding the word "submission") which are reviewed and potentially generate submissions (a sort of reviewed and potentially modified transmutation from the original suggestion), that is a totally different beast and I am not at all sure it makes sense to leverage the current submission system for this sort of thing. I believe Fixer and other bot like "animals", normally do not make arbitrary submissions but only very specific types (mostly NewPub; someone tell me what other types it can make). As such, it might make much more sense to have separate NewPub (suggestion? submission?) queue. A reviewer could then load such NewPub items into the NewPub editor, potentially make changes, and make the submission (or mark the suggestion rejected). This would greatly simply such an implementation (which would still not be trivial). It might also make sense for bots to mark items in this NewPub queue as completed (or actually delete them) when it noticed the items appear in the main database that match the NewPub suggestion it previously made. For this purpose, there should probably be a way for bots to query this queue (with search requests like "give me all outstanding NewPub items I provided but I have not marked as completed/deleted"). Frankly, I see this as more of a remote bot NewPub queue than an automated submission queue. Uzume 01:24, 20 February 2017 (UTC)

AddPub as well when it manages to recognize where a new publication belong. Fixer founds a few thousand new ISBNs every month. They need to be added to our DB - but they do need a lot of cleanup. What is your proposal - how those say 6 0000 publications get added without the new process and without burning out all the moderators? If Fixer can just dump them in a new queue where someone can go, edit and then submit to the moderators, this is exactly what the FR is proposing - call it automated submission queue, call it "list of possible NewPub/AddPub", call it whatever you want :) So do you just disagree with the name? What you describe here is exactly what the FR is proposing... It is not about changing the current process, it is about adding a new process BEFORE the current one that will allow these ratty ones to be streamlined for the process. Annie 01:39, 20 February 2017 (UTC)
That is not how the FR is written "Change the submission table to support a new submission state, “A”utomated" implies modification of the current submission queue. I do not think that is appropriate if what is really needed is a remote bot queue with limited input types. Uzume 02:11, 20 February 2017 (UTC)
Look at point 10 in the FR - that is what ties it back into the standard process. Annie 02:13, 20 February 2017 (UTC)
I see that now, however, I still think that unduly complicates the submission system with little value. I believe we would be better off with a new different specialized queue than trying to shoehorn this functionality into the current submission queue. Uzume 02:20, 20 February 2017 (UTC)
The linked FR would effectively create a new specialized queue. Editors would then use "automated"/robotic entries in that queue to create regular submissions. Implementing various supporting mechanisms -- like putting the automated submission on hold as described in the FR -- would be somewhat challenging, but I think it should be doable. Ahasuerus 04:58, 20 February 2017 (UTC)
I imagine it would be challenging both on the API server side of things as well on the bot client side of that (what does/should Fixer do with such a remote queue item marked on hold?). Uzume 05:23, 20 February 2017 (UTC)
When Fixer sends a submission via the Web API, he marks the ISBN as "submitted" in his internal database. From that point on he ignores the ISBN.
When Fixer gets the next weekly backup, he updates his internal database with the data from the backup. At that point the status of moderator-approved ISBNs changes from "submitted" to "already in the ISFDB". Moderator-rejected ISBNs remain "submitted" forever. It doesn't really make a difference because Fixer ignores "already on file" ISBNs just like he ignores "submitted" ISBNs. Adding a new queue on the server side shouldn't change this logic on the client side. Ahasuerus 15:16, 20 February 2017 (UTC)

(unindent) If there's a separate queue, that queue will probably back up (esp. once the novelty wears off). If it does back up, we'll end up in a situation where more of its entries turn out to be duplicated by live-editor submissions that were created without consulting that queue. It might be better to get more moderators and let Fixer submissions flow through without any sort of pre-qualification/filtering that's being done now. We are not particularly aggressive about recruiting moderators. --MartyD 12:03, 20 February 2017 (UTC)

Unfortunately, the main problem is not that we don't have enough moderators. The main problem is that processing robotic submissions requires a significant amount of research and TLC. Some moderators have the time and the energy to do the necessary research. Others don't and simply click the "Approve" button if the submission looks OK. This is the main reason why I only submit on Fixer's behalf if:
  • I am 99% sure that the submission (usually an AddPub) is truly OK "as is", or
  • it's a relatively low priority ISBN and it's better to have it on file in a potentially suboptimal state than not to have it at all
Over the years, I have tried a number of strategies to improve the situation, all of them unsuccessful.
The "automated submissions queue" is the latest stratagem in a long list. The idea is that having human editors do the requisite research up front would result in higher quality submissions to be reviewed by moderators. Admittedly, if a moderator wants to pull up the new queue and simply approve everything in it, it won't stop it.
If there is a better solution to this problem, I'd love to hear it. The current situation is barely sustainable as it is and will continue to deteriorate as my productivity declines over time. (Not to mention the increased number of SF books being published.) Ahasuerus 19:15, 20 February 2017 (UTC)
That makes more sense and I prefer that idea. This is why I am sort of against the idea of another queue (particularly if it is shoehorned in the the existing one as the first part of the current FR describes) despite its possible value in being able to modify the entries at review time (it seems like much work where this is the only key value). That said, it might make sense to add generalized editor review for the main submission queue (it could be limited in some way if there are security concerns). Such reviews could help moderators more quickly decide when closing submissions. As Marty points out such things may turn into a novelty (but then same could be said of moderators; look at how many inactive or barely active ones we have at the moment), but it might ebb and flow with new or return editors, etc. Aside from the possible value of possible valuable reviews to speed in moderation, it seems like a better tool to use when hunting for moderator candidates (so though this too might be complex and end up perhaps with smaller value this part seems to me the most valuable part). Uzume 18:24, 20 February 2017 (UTC)
If we go this way, we really should have a prioritization of some type available so that live editor updates do not get backed up when Fixer dumps its submissions. It is very annoying to wait for a moderator to approve something so you can send the next update (especially when you are new) :) Annie 05:32, 21 February 2017 (UTC)

Adding support for translators and possibly other roles

Add support for translators (as well as other roles like single-author collection editors?) Ahasuerus 23:45, 19 February 2017 (UTC)

Ok for the former, no to the latter, why not editor of novels? Hauck 20:08, 19 February 2017 (UTC)
A collection editor usually chose the stories, a novel editor does not chose content in the same way. I think we should allow such editors be somehow recognized. Annie 20:52, 19 February 2017 (UTC)
I am with Hervé here. I would like to added more contribution types supported when we have no way to capture such now but I would be wary of taking what we already have and dividing it down (into different types of authors/editors or different types of artists, etc.). I definitely want to see translators (since our current rules have no fields to capture this short of ad hoc notes). I am curious why we cannot just add translators as authors of translation title records and just reach through the VT to find the original authors instead of adding a new contributor type (we do not need one for artists they just tend to have different types of works; a different language VT work is a different type of work). If we implement such, we could have a cleanup report for translations where the canonical authors (jumping through pseudonyms) match authors of the original work allowing us to convert these over time (translations without translators report). Uzume 23:20, 19 February 2017 (UTC)
So you are proposing the Bulgarian variant of Dune to have as an author the translator? How would you separate on the translator page the ones he did write from the ones he translated? And if a user does not understand out variant system, they can misunderstand who the writer is. Plus this way we are losing the ability to have the actual author name in the language of the variant... Artists are different because they are different works - the translation by definition has two authors - the original one and the translator. Annie 23:24, 19 February 2017 (UTC)
The software can display these differently by reaching through the translation variant and author psuedonyms to properly credit authors vs. translators. Uzume 23:33, 19 February 2017 (UTC)
How about an example. Dune by Frank Herbert is translated as Дюн by Франк Хърбърт, translated by Виолета Чушкова. Which name goes where in your idea? Annie 23:37, 19 February 2017 (UTC)
I am assuming we are referring to T1442269. I am suggesting we just add Виолета Чушкова to this record as an author and the software just credits the translators differently than the authors by chasing the authors of this record from A237335 to A30 (since A237335 is a pseudonym) and whatever number Виолета Чушкова ends up (since that is not currently in the DB) and comparing that to the authors from T2036 (which is the variant translation parent of T1442269) which is A30. The software can clearly detect that A30 is the original author and whatever number Виолета Чушкова ends up is not (and thus is a translator). In a similar vein, cleanup reports could be generated for translations without translators. It should be noted that all of the above data is already required to display and properly link these entries anyway. This proposal just suggests handling that data differently to allow for and credit translators (there is already an FR900 for displaying translations differently; I just want to add translator credit support to that and propagating it to more than just title pages). Uzume 00:10, 20 February 2017 (UTC)
None of your links work by the way - you may want to look at the templates again:) The example was from my library. I get where you are getting with that. But... what about the case where it is not just a translation but also an abridgement. This is when the second author gets added now. And that will make the translator author page a nightmare for the software to work out - in which cases the author is a translator, in which cases he/she is a co-author, in which case an author. Not to mention that the searches for translators will become overly complicated. Annie 00:14, 20 February 2017 (UTC)
Currently our rules rule out using the VT mechanism for any derived (where the contents is significantly different) works except translations so that should not be an issue. In partially translated works and the like there should be no VT parent and whether an author is an translator or not becomes muddled to begin with. I believe it would be best to list all contributors as authors and specify who did what in the notes (much as is done with certain types of authorship now). Uzume 00:26, 20 February 2017 (UTC)
Not true. Abridgements are variants - in a way a lot of translations are abridgements, especially the older ones. As are two parts of a split novel. Revised novels also get varianted... Annie 00:42, 20 February 2017 (UTC)
We did not used to allow VT title records except to change the title or author and then later allowed translations (i.e., changes in the language). If indeed we now allow other derived type VT title records, I would prefer a translation flag marking a VT title record as a translation over adding new contributor role flags (add a field to title records instead of to author records). The problem with using the VT mechanism for generalized derivatives is: what constitutes a derivative? Is something a derivative if it is barely inspired by something else? As you can see this gets rather sticky quickly and the resulting connections are more then the VT system can support (since that would actually require a generalized graph construct). Uzume 01:38, 20 February 2017 (UTC)
We are already using them for that (as much as I dislike it in some cases - split novels for example) - the question is how to make it a bit more manageable. And as for the flags - if a variant is an abridgement AND a translation from different people, how do we determine who is who? We can use additional authors but we will need a flag on the author as well... Annie 01:52, 20 February 2017 (UTC)
You cannot use VT to specify abridgement AND a translation by different people anyway. That would require more than a two title records to express (one would have to link the translation to the abridgement and the abridgement to the original; our VT mechanism specifically does not allow generalized graph structures). Uzume 02:08, 20 February 2017 (UTC)
You cannot have a variant of a variant - so if my Bulgarian book is an abridgement and a translation, it goes under the main work directly. You need one title to express - you just need to add notes. Annie 03:21, 20 February 2017 (UTC)
Exactly, and in the same notes that qualify such you can qualify the contributors as well. If you cannot have the titles linked perfectly (outside of notes) it makes little sense to try and credit people perfectly. Just as you have to pick the parent (even if it is not right) you can pick if it is a derived work or a translation (even if neither of those is entirely right either). If we ever support such a linking then the credits will be able to be right too. I see little reason to hack around credits to solve the real problem. Uzume 04:12, 20 February 2017 (UTC)
And here we ended up on a circle. I cannot see how your idea is easier than a new role (considering all the additional work that will be needed to populate summary pages. And if it is not separate, something will need to be done on the publication and title pages to identify them as translators/whatever they are anyway because new contributors will be confused. Annie 04:20, 20 February 2017 (UTC)
Easier solutions do not always make for better solutions (in fact the easy way often ends up being hard long term). I am not sure how new contributors would be any more confused than by which is the proper variant parent (which cannot be set properly too). Uzume 04:54, 20 February 2017 (UTC)

(unindent) The issue of translator support has been open for close to 5 years now, so I don't expect us to come up with a perfect solution in a few hours. There are various aspects to consider, e.g. the fact that there are awards given to translations rather than to titles.

The reason that I mentioned "roles" is that whatever design we come up with will ideally also support other "roles" like single-author collection editors. The exact roles that we will eventually choose to support are less important than the decision to make the design extensible -- or not, if we find that translators are sufficiently different from other "roles". Ahasuerus 05:11, 20 February 2017 (UTC)

Yes, I was not suggesting the translators issue would be solved anytime soon. I am against dividing our author records into roles however, and just wanted to state that there are potential solutions for the translators issue without depending on the introduction of divided contributor role tags. If we do end up supporting such role tags, I would recommend corollaries for publisher roles (or any other authority control item), etc. Uzume 05:16, 20 February 2017 (UTC)
I don't know how useful it is to researchers, but I like the idea of being able to capture/catalogue various roles. Part of the challenge right now is that the nature of the relationship is embedded in one of the two ends (mostly in the publication/title end, but sometimes in the author end). Thinking about the relationship in terms of a generic "contributor", I could see typed Contributor relationships instead -- the nature of the relationship stored on the relationship. There could be many of these, and a pre-defined set of types. One type would be "Author", another "Editor", another "Translator", and so on. The bibliographic summaries for people could be organized by roles, then title types. To keep things simple and avoid big mistakes, the software could provide some specialized handling for required roles (e.g., it could still present Author (for single works, collection, and omnibus) or Editor (for anthology and magazine)) and then "other contributors" or something like that for everything else (just like we get the Title record but then other Contents). --MartyD 17:42, 20 February 2017 (UTC)
I have been thinking along similar lines for a while now. However, redoing the author logic (and the variant title logic and a lot of other things) would be a daunting proposition. It may be less painful to declare authors and anthology/magazine editors a "special privileged case" and implement a generalized "contributor/role" mechanism for translators, other types of editors, etc, separately. Once the new mechanism is in place and everything is working smoothly, we can look into migrating "special case" authors/editors to the new system.
Granted, a two-step approach is not without its dangers -- I once worked on a multi-billion dollar project which took this route and never completed the second step -- but we may be better off even if we never complete the second step. Ahasuerus 23:59, 20 February 2017 (UTC)
Well, we need to solve it if we really want to claim that ISFDB is international. I do not want to add 3000 works just to have to edit them in a year to get the translators sorted... Just saying :) And I like Marty's idea. Annie 00:04, 21 February 2017 (UTC)

Non-Genre flag for authors

Add a “non-genre” field to author records; create a cleanup report to find non-genre titles by non-genre authors. Ahasuerus 00:04, 20 February 2017 (UTC)

This will open the gates to well-intentioned persons that will want to enter such authors (as with the "graphic" or "non-genre") as it will look possible. Bonus problem: how to define a non-genre author.Hauck 20:08, 19 February 2017 (UTC)
[Discussion of author birthdays and dates of death displayed on the front page moved here.]
I believe adding a genre field to authors should be fairly easy and provide good value (like moderator warnings on submissions when adding non-genre or graphic content to non-genre authors, etc.). @Hauck: all authors are non-genre by default and those "over the fold" get promoted to "genre" and we allow (nearly) all content for them. Uzume 21:36, 19 February 2017 (UTC)
Sure, and promoted by who? We're back to the remarkably precise definition of "over-the-threshold" (or "over-the-fold"). This may sound funny but trying to explain for the upteenth time to another new contributor all these perfectly nebular notions may prove an interesting expreience for those who do not practice it. Hauck 21:55, 19 February 2017 (UTC)
Promotion (and demotion) is via the moderated submission process (changing the author genre/non-genre checkbox). It could be restricted to moderators too (like author canonical renaming, etc.) though I am not sure that is necessary. Education is always useful and we already have the rule. The only difference is having a field to declare such. Uzume 22:58, 19 February 2017 (UTC)
I really do not like the idea. I do not think that we should have non-genre works even by the over the threshold authors but that ship had sailed. And how we will determine who is genre author? If someone has a story/essay here, they are an author with genre works. Anyone that has at least one non-genre work is again an author with genre works. Trying to draw the line in the middle is going to cause a lot of unnecessary edits.
I can think of a few Bulgarian authors that had written both SF and Crime works and are considered masters of both. I would not add their crime works here or call them non-genre because they just happen to also had written outside the genre. Even the ones that under the usual "rules" will be over the threshold. Annie 00:10, 20 February 2017 (UTC)
This is already specified in our Rules of Acquisition. I agree some cases are not clear cut. If you want to challenge the rule (or champion a specific author for promotion or demotion) that is a different discussion than implementing it in software. Uzume 00:20, 20 February 2017 (UTC)
It does not determine what a non-genre author is. Again - where would you like to draw the line? If you want it to be based on what an editor wants to nominate, it becomes meaningless... Annie 02:14, 20 February 2017 (UTC)
What you are saying is the current Rules of Acquisition are meaningless in this regard (and I agree that could be argued) but that is a different (though valuable) discussion. Uzume 02:38, 20 February 2017 (UTC)
No, what I am saying is that the rules determine which works are added but do not qualify authors as genre or non-genre ones (above the threshold is not a determination of that).Annie 02:52, 20 February 2017 (UTC)
This seems a pointless designation. If an author has written a genre story, they are by definition a genre author. If it is attempt to designate authors who write primarily genre stories, what is the point? If it is an attempt to designate authors who are 'above the threshold', that is not the same as authors who primarily write genre stories so the name is deceiving. And as Hauk has pointed out 'above the threshold' is a nebulous thing that is not well suited to a database field. -- JLaTondre (talk) 01:15, 20 February 2017 (UTC)
I am curious why you think this is not suited to a database field? I agree an author could be promoted or demoted to threshold levels over time (an author starts out in one genre and gravitates to another). Should instead every editor and moderator know and potentially reevaluate each author upon every submission? That would make for very complex submission criteria and potentially break the rules of acquisition as different people came to different conclusions at each point in time. Uzume 01:58, 20 February 2017 (UTC)
Everyone has a different opinion of 'above the threshold'. People already come to different conclusions. A database field is not going to change that nor is it going to change that different editors and moderators apply it differently. It would just be a field they can now edit war over. -- JLaTondre (talk) 02:17, 20 February 2017 (UTC)
Edit warring over that single field is considerably more noticeable than generalized edit warring over all the pubs and titles of an author which what we are already at. If there is an edit war over that field it will be noticed and brought to community discussion more easily and thereby a consensus can be reached. I agree we could also likely generate some sort of automated heuristic to flag if an author should be above the threshold (by counting title and/or pub records) but it would not take into account exceptions by consensus. But the proposed flag is meant to hold the current value of community consensus (which obviously can change). Uzume 02:32, 20 February 2017 (UTC)

Derived and corrected ISBNs

Add two checkboxes next to each ISBN: “derived” and “corrected”. The latter will let us capture two versions of invalid ISBNs, the stated one and the corrected one. Ahasuerus 00:12, 20 February 2017 (UTC)

Not frequent enough to clutter the screen, better use the note field instead.Hauck 20:08, 19 February 2017 (UTC)
I agree with Herve on that one. Annie 20:52, 19 February 2017 (UTC)
The proposed check boxes would only appear on Edit/Add/Clone Publication pages. Regular Publication pages would continue to display "(Bad Checksum)" for invalid ISBNs like they do now.
The advantage of having invalid ISBNs captured in the ISBN field vs. in the Notes field is that it enables searches. For example, if you search for the ISBN stated in Alpha 5 (0-345-24140-X), you won't find it because it's only available in Notes at this time. When dealing with invalid ISBNs, we have always had to choose whether to enter the stated version or the corrected version in the ISBN field. The other version was relegated to Notes where it became unsearchable. With the addition of support for multiple ISBNs, we will no longer have to choose -- we will be able to eat our cake and have it too! :-)
As far as derived ISBNs go, there are hundreds, if not thousands, of them in the database, mostly from the mid-1970s when the industry was transitioning from catalog IDs to SBNs and then to ISBNs. It's always made me uneasy that we claim, e.g., that Alpha 4's ISBN is 0-345-23564-9 even though it says "345-23564-9-125" in the book. If we add a check box to the edit page, the main Publication page will be able to indicate that the ISBN value was derived. Ahasuerus 03:15, 20 February 2017 (UTC)
I too agree and believe implementing ISBNs as identifiers (a different FR) will likely solve much of this problem anyway. The key is to differentiate identification (e.g., cover price, etc. which can be erroneous) from identifiers (which probably should not be erroneous). Uzume 00:23, 20 February 2017 (UTC)
I still believe most usages of this can be covered by treating valid ISBNs as identifiers (in the as yet unimplemented identifiers FR) and invalid ISBNs as catalog numbers. Here is some potentially pertinent information on this subject: MARC ISBN. Uzume 03:47, 20 February 2017 (UTC)
Back when I was working on the design of the "third party identifiers" FR, I considered making catalog IDs and ISBNs just another type of identifier. Eventually I decided against it for a number of reasons:
  • Unlike third party identifiers, catalog IDs and ISBNs are stated in publications
  • Also unlike third party identifiers, catalog IDs and ISBNs are displayed on various "Publication Listing" pages
  • ISBN searches are "privileged" in the sense that they are available via the main search box
  • ISBN searches use a special ISBN-10/ISBN-13 conversion algorithm so that a search on an ISBN-10 finds a matching ISBN-13 and vice versa
  • ISBNs can be "derived" or "corrected" as described above
In the end I decided that catalog IDs and especially ISBNs were sufficiently different animals to merit separate places in the database. Ahasuerus 04:17, 20 February 2017 (UTC)
Those are good points, however, an ISBN as an identifier can be converted to a 13 digit number in all cases (and left in original ISBN-10, SBN or other brokenness as stated in the publication in other cases like the catalog number field). When searching ISBN identifiers, ISBN-10s to search for can be converted to 13 digit numbers before comparisons (so there is no issue). It would not be so hard to have a combined search for these and the catalog field(s) (matching original input against catalog fields and any convertible ISBN-13 against the identifier fields). Though very common, all (and sometime any) ISBNs for an edition are not always stated in its printed publications (e.g., I have seen some that only have an GTIN-14 which contains the ISBN-13 and another digit). I am not sure it is worthwhile to implement ISBN as both catalog numbers and identifiers and to accomplish such (but it is something to think about). Another issue is broken punctuation in ISBN. I know sometimes an ISBN is stated in a publication with improperly placed hyphens (I have no idea how we handle this if at all; I am guessing we do not maintain this original statement). Uzume 04:49, 20 February 2017 (UTC)
There is a great deal (2427 lines to be precise) of ISBN formatting logic in this module. It's yet another way in which ISBNs are different from third party identifiers. Ahasuerus 15:20, 20 February 2017 (UTC)

Changing "Family Name" to "Directory Entry"

Change “Family Name” to “Directory Entry”. If we allow multiple values to support different alphabets/scripts, how will we sort by this field? Ahasuerus 02:39, 20 February 2017 (UTC)

Switching to unicode and then sorting by it will be cleanest. Until then I kinda like it as it is (as long at non-Latin entries actually have their transliterations properly and not getting defaulted to the name of the author in English. Annie 20:52, 19 February 2017 (UTC)
I have been looking forward to the DB moving to some Unicode encoding like UTF-8 for a long time (currently it is only pseudo-Unicode by way of using HTML entities). Multiple directory entries solves more than just multiple script/language issues (see ISFDB:Community Portal/Archive/Archive41#Sorting, author directory and nobiliary particles). Multiple scripts can be handled by multiple directories. Uzume 00:51, 20 February 2017 (UTC)
Multiple scripts/multiple directories becomes a bit of an issue with author names with letters from two separate scripts - Macedonian or Ukrainian names for example which combine Cyrillic (somewhat creative on some letters) and Latin letters. Which directory will have these forms? Or do we start a separate directory for each of them? Annie 02:44, 20 February 2017 (UTC)
This is not necessarily their real name anyway. I would suggest making entries for both (all Cyrillic and all Latin even if their real name is a mixture of the two). Uzume 03:03, 20 February 2017 (UTC)
For Ukrainian and Macedonian authors, it IS their real name. And we all hope we will get more international entries, right? Saying that they do not deserve their real names in a directory while we have everyone else's name there will be a bit... uninclusive. Annie 03:19, 20 February 2017 (UTC)
I do not see how that is an issue. The above mentioned "nobiliary particles" discussion proposed having multiple entries based on different cultural conventions in different places. Uzume 03:29, 20 February 2017 (UTC)
So separate directory for each language we support (I am just trying to make sure I understand the idea) Annie 03:37, 20 February 2017 (UTC)
No, not for every language. One per script (all Latin in one, all Cyrillic in another, etc.) implemented as time and demand allows. This means for example English language authors would be found in the same directory as German ones. Another example of directory entries that do not match real names would be Japanese (which would have kana entries) where I do not think we want to consider a kanji Chinese character directory (I have no clue how we would do such for actual Chinese names). Uzume 03:53, 20 February 2017 (UTC)

(unindent) Let's take a step back and examine the uses (current and proposed) of the "Family Name" (soon to become "Directory Name") field. At this time it is used to do 2 things:

Making this field a "multiply occurring field" will make it possible for an author record to appear on multiple Author Directory pages. For example, if we specify "de la Roche" as well as "Roche" as Mazo de la Roche's Directory Entries, his name will appear on two different Author Directory pages. Once we implement non-Latin Author Directories, it will also enable us to make the same author appear in multiple directories.

So far so good. However, once an author has multiple "Directory Entry" values, we will have no way of using them for sorting purposes. Unless we make one of them our "preferred sorting value", I guess. Ahasuerus 03:49, 20 February 2017 (UTC)

Agreed. And as such instead of having a "preferred" tag, why not treat this like transliterations. You have a Family name with "transliterated" Directory names on top. This would allow a mixed (potentially collating) name as a family name (we could have Cyrillic and Latin or kanji and kana in this field) and single script directory names on top. Uzume 03:57, 20 February 2017 (UTC)
I am not sure I understand what "on top", "mixed name" and "potentially collating name" mean in this context. It sounds like you may be suggesting that we keep the current "Family name" field and add a new multiply occurring field for "Additional Directory Entries". The latter would be used for names like "Roche" in the "Mazo de la Roche" example above as well as transliterations. The former would continue to be used for sorting purposes. Is that about right? Ahasuerus 15:45, 20 February 2017 (UTC)

Add support for additional title types

Add support for additional title types like PLAY and FICTITIOUS ESSAY (requires discussion to come up with additional values) Ahasuerus 02:41, 20 February 2017 (UTC)

Not enough candidates to warrant new types.Hauck 20:08, 19 February 2017 (UTC)
Maybe not for fictitious essays; --Vasha 00:52, 20 February 2017 (UTC)
"Fictitious essays" or "fictional essays" are basically "in-universe" essay. They are written as if the events of the work that they are associated with were true. They have prompted many discussions since it's not clear whether they are "essays" or "short fiction". Help currently says:
  • Some books contain fictional essays, purporting to written by a character in the book, as introductions or afterwords. There is no "FICTIONAL ESSAY" title type, so you have to choose whether the title is better described as SHORTFICTION or ESSAY.
There have been repeated request to implement a separate title type for them. Ahasuerus 02:48, 20 February 2017 (UTC)
Well then, if there have been repeated requests, clearly there are enough cases to justify adding the new type. And I will say it definitely sounds useful to me. --Vasha 03:37, 20 February 2017 (UTC)
but for plays, even if there aren't that many of them, the difference between them and SHORTFICTION is so obvious that they need their own title type. --Vasha 00:52, 20 February 2017 (UTC)
I would also like to see a separate title type for plays, but we will need to decide how to handle related cases first. For example, are movie scripts, TV scripts, etc separate types or are they all the same type? If they are the same, should we come up with a more generic term than "play"? Ahasuerus 02:51, 20 February 2017 (UTC)
"script" covers plays, audioplays, tv scripts, and even librettos I think. --Vasha 03:37, 20 February 2017 (UTC)
(And for the other one I would like to see a new type for, excerpts, there really are a lot.) --Vasha 00:52, 20 February 2017 (UTC)
The vast majority of excerpts are works of short fiction. Should we treat them as a separate title type or as a separate "length" value like novellas, short stories and novelettes? Ahasuerus 02:52, 20 February 2017 (UTC)
I'd like a separate length value for these - this will separate them from the real short fiction. Annie 02:54, 20 February 2017 (UTC)
Keep in mind that if we add "excerpt" as a new "length" value, it won't separate excerpts from other works of short fiction on Summary pages. Ahasuerus 03:18, 20 February 2017 (UTC)
I believe you mean it won't currently separate such (the software could be made to do such without huge issues though I am not convinced that is a good idea). I vote for an "excerpt" "length" value. Uzume 03:21, 20 February 2017 (UTC)
I do not like seeing novel excerpts mixed in with the actual short fiction on the summary pages. --Vasha 03:37, 20 February 2017 (UTC)
It does not do it now anyway (See Asimov - the third and the forth are excerpts... If we go for separation one day, we may start talking about separating all lengths from each other anyway. What I meant upstream was that it will allow the excerpts to be seen easier. And allow searching them - and searching without stumbling at them. Annie 03:40, 20 February 2017 (UTC)
Agreed. Though I am not convinced about separating such on author pages. One can create custom pages via search that show just what you want. Uzume 04:17, 20 February 2017 (UTC)
I would be strongly against separating all lengths on author pages. It's not of interest under most circumstances, plus every author has lots of unspecified lengths. --Vasha 04:21, 20 February 2017 (UTC)
I am not exactly vying for it but it might be interesting to consider user preferences allowing one to select which lengths one wants to see (much as language selection is possible this way). Uzume 04:25, 20 February 2017 (UTC)
I like that, it would speed up searching for titles on prolific author pages. Maybe checkboxes for all title types on the author page rather then setting it in user preferences.--Rkihara 18:23, 20 February 2017 (UTC)
The question wasn't choosing which title types to display, but rather displaying ss/novelette/novella separately. It's this that I think would not be good on summary pages. As a preference option, OK maybe. --Vasha 20:55, 20 February 2017 (UTC)
If the intent is to separate excerpts from other SHORTFICTION titles on Summary pages, then I believe they need to be turned into a separate title type. Using "length" values to create separate Summary page sections would go against the basic "one title type = one Summary page section" principle. Ahasuerus 23:43, 20 February 2017 (UTC)
Excerpts are short fiction -- it does not really make sense to have them as a separate type any more than novellas are separate type. At least I cannot see a difference... If we split them in a separate type, then why would not things like half a novel published in a volume go into that same new type? Where do we draw the line? At least as a part of the short fiction, that line is clear. Annie 17:05, 21 February 2017 (UTC)
Yes, sometimes excerpts are carefully selected so that they form a complete short story; more often they actually don't seem complete in themselves. --Vasha 17:39, 21 February 2017 (UTC)

(copied from a side discussion in another section) If excerpt got added to the mix [of length options] it would be hard to "sort" that with the others. Uzume 01:28, 25 February 2017 (UTC)

I think you may be the only one who likes the idea of "excerpt" being a length... everyone else was talking about it being a title type --Vasha 01:32, 25 February 2017 (UTC)
That was not how I read things (but perhaps I misunderstood). As title type seems that seems problematic. As a length, I could usefully apply it to essays and nonfiction (like an excerpt of a bibliographic index, etc.) as well. Uzume 01:43, 25 February 2017 (UTC)
I read it as a support for Length as well :) However to your latest point here: length may be showing when you are working on publications for all titles but if you read the documentation and look at editTitle for example, it is valid only for Short Fiction. Making it usable elsewhere will probably require a lot of other changes (even if it becomes a length). Annie 01:46, 25 February 2017 (UTC)
OK, I can sort of see excerpt as a length, in that I hesitate to assign a length to excerpts -- they don't strike me as "really" being a short story or novelette. But that is the very reason that they seem to me to be a separate kind of thing, not short fiction. Besides, I like the idea of having excerpts be a separate section on summary pages, for which they'd have to be a title type. But maybe I am the only one who wants that. --Vasha 02:15, 25 February 2017 (UTC)

Third party identifiers

Support for third party IDs (OCLC, BLIC, LCCN, BNF, ASIN, Goodreads, etc). This will enable Fixer to submit ebooks without ISBNs, an increasingly common scenario.

Good to have some way of identifying ebooks but most of those you listed are ephemeral. Particularly ASIN. (I don't put ASIN in the notes field of an ebook because there are probably numerous ones most of which will disappear soon.) Goodreads has the advantage that they keep records for out-of-print ebooks (it's their policy not to delete) but they're very unsystematic, their records can get merged with each other, etc. --Vasha 17:49, 20 February 2017 (UTC)
Library IDs (OCLC/WorldCat, BLIC, LCCN, BNF, etc) are generally stable, at least as stable as our IDs. We currently link to them in Notes, which requires crafting URLs manually, an error-prone and time-consuming process. In addition, manually built links can become defunct if/when the third party changes its URLs conventions, as we have seen over the last few years. ASINs may not be quite not as stable as, says, LCCNs, but in most cases they work even years after the data was captured. They are frequently the only way to link to the source of our data. Even more importantly, without ASIN support Fixer is unable to submit ebooks without ISBNs, which are increasingly common. Even major authors publish e-stories without ISBNs these days and Fixer can't do anything about them. Ahasuerus 18:10, 20 February 2017 (UTC)
I would certainly like to be able to use library IDs as identifiers for non-ISBN print books. Having support for that makes sense. But Worldcat doesn't list ebooks -- what about other libraries? --Vasha 18:30, 20 February 2017 (UTC)
Some do, but the intent of this FR is to support third party IDs regardless of whether they are for paper books or ebooks. Ahasuerus 18:46, 20 February 2017 (UTC)
As for automatically importing ebooks, that opens a can of worms. We had an inconclusive discussion a while back about what constitutes an "edition" of an ebook. Personally I would like to see them condensed not too many; the way Goodreads has so many is bewildering and ugly. So if you automatically import them there's have to be manual combining. --Vasha 18:30, 20 February 2017 (UTC)
Fixer has been generating ISBN-based ebook submissions for many years. Submitting ASIN-based ISBN-less ebooks should be no different than submitting ISBN-based ebooks once we add support for third party IDs. Where it will get challenging is if we start using another source of ISBN-less ebooks. Suppose Fixer creates a database record for an ISBN-less ebook whose ASIN is "ABC". 6 months later an editor (or another robot) wants to add a record for a Barnes & Noble ebook whose B&N ID is "XYZ". How can we tell whether it's same version of the ebook, especially if the publisher is not specified and the publication dates are close? OTOH, as long as we stick to ASINs, we should be in reasonably good shape since different ASINs are generally associated with different editions. Ahasuerus 18:56, 20 February 2017 (UTC)
Amazon actually doesn't have every single ebook. Graydon Saunders is a fairly notable example of an author who choose not to offer his books via Amazon because he objected to their terms. --Vasha 20:21, 20 February 2017 (UTC)
Oh, definitely. However, as long as we add these books manually, we are less likely to run into problems. It's the robotic submissions that worry me. I have seen many cases where an ebook was originally added by a human editor without an ISBN -- because Amazon doesn't display ISBNs for ebooks even if they exist -- and then Fixer came along and tried to add the same book using its ISBN. (This particular problem will be alleviated by adding support for third party identifiers.) If we were to start using other online sources to grab ISBN-less ebooks, the problem would become more severe. Ahasuerus 20:35, 20 February 2017 (UTC)

(unindent) I believe the next most interesting item is adding support for identifiers. This is a bit sticky but useful concept. The sticky part comes in where we apply these. I believe you were mostly considering at the pub record level, however, the identifiers in this area are themselves usually defined for the concept of an "edition" (which we have no real records for since our pub records most closely correspond to a printing, save for SFBC). This probably is not a major issue but something to consider. Uzume 21:36, 19 February 2017 (UTC)

True, different catalogs and Web sites create records at different levels. For example, an OCLC record may cover multiple ISBNs. Alternatively, multiple OCLC records may cover the same ISBN. I don't think there isn't much we can do about it. Adding support for third party IDs is the best I can think of. Ahasuerus 19:50, 20 February 2017 (UTC)

Next, there is the issue of untangling ISBNs. Currently, our pub record ISBN field represents an identifying mark of the publication (along with cover price, etc.) and we just sort of play games with it to allow is to link to other sites by using it as an identifier. Uzume 21:36, 19 February 2017 (UTC)

Well, ISBNs were originally supposed to be unique and they are still used as "mostly unique" by the industry, e.g. when ordering books. Of course, as we know, publishers can tweak things like cover art and price while keeping the same ISBN. And sometimes they mess up and reuse an ISBN which they didn't intend to reuse. Still, ISBNs are the only IDs that can be used cross-catalog and cross-site with a reasonably high chance of success. Our use of ISBNs to link to other sites is the way they were intended to be used. It's not perfect -- see the OCLC discussion above -- which is one of the reasons why adding support for third party identifiers is useful.
For example, suppose an editor wants to record that some of our data originally came from OCLC records. At this time the only choices are either to:
  • enter something like "Corrected page count from OCLC 1234567, artist from OCLC 987653", or
  • manually craft URLs pointing to the OCLC records
The second options provides more value but is error-prone and time-consuming, not to mention that URL structures can change over time. Once we add support for third party identifiers, editors will be able to enter OCLC record numbers directly. Ahasuerus 20:05, 20 February 2017 (UTC)

An easy way to untangle this is to run some code on our ISBN fields and move them to ISBN identifiers and keep the original field for verbatim publication catalog markings (including wrong/broken ISBNs, etc.). This way we change the current field to a verbatim publication identification field and move identifiers and external linking to use the newly introduced identifiers (including derived/corrected ISBNs etc.). Then we just have to update documentation to keep the fields separate (I recommend renaming the current field as catalog number and documenting it to apply to cover or copyright page catalog numbers, etc.; we could expand it to allow multiple values but frankly I would say that unneeded and can be covered in the note field). Finally, identifiers are also useful at other levels such as author and/or publisher authority control (e.g., VIAF, LCNAF, etc.), and for tags with regard to subject indexing terms (e.g., LCSH, FAST, etc.). Some identifiers also apply to the work (our title record) level (e.g., Open Library works, Wikidata, etc.). Uzume 21:36, 19 February 2017 (UTC)

Yes, author-based and title-based identifiers are something to consider. Currently we enter VIAF links as "Web sites". If and when their URL structure changes, we will have to change the URLs manually or write a conversion script. If we had author-based third party identifiers, the problem could be resolved in 10 minutes. I agree that they would be nice to have, but I see it as a much lower priority than publication-based identifiers. Ahasuerus 19:32, 20 February 2017 (UTC)
Maybe, but we could for instance move Wikipedia links to go through Wikidata identifiers with links like enwiki/Q982133, frwiki/Q982133 and jawiki/Q982133 for John Norman allowing the links to be translatable (without storing and maintaining all the various links) not to mention other possibilities like enwikiquote/Q982133 (provided the sitelink for such articles exist). Uzume 00:47, 25 February 2017 (UTC)

(unindent) OK, I have been thinking about this -- how about this for an addition to the edit-publication page. Below the ISBN field, the ability to add fields for an indefinite number of other identifiers (a button that says "Add Identifier" or whatever), and next to each of these fields a dropdown list to specify what the identifier is: ASIN, OCLC number, publisher's catalog code, however many options seems useful. (Naturally, the submission would be flagged if you try to submit a number without specifying its type -- and maybe, at least for some of them, could be flagged if it's not a valid format for the type specified.) Would that work? --Vasha 01:52, 2 March 2017 (UTC)

That's actually extremely close to the implementation that I sketched out last year :-) Ahasuerus 03:11, 2 March 2017 (UTC)

Author birthdays and dates of death on the front page

This one was discussed (perhaps not for the first time) when I noted that the list of birthdays on the home page was growing too long to be interesting. Instead of limiting that list to only "genre" authors, whatever they are, maybe limit it to authors with a certain minimum number of titles? --Vasha 21:30, 19 February 2017 (UTC)

That's a good point. Perhaps the algorithm could be fine-tuned to select:
  • award-winning and award-nominated authors
  • authors with more than N titles
The only difficulty is that identifying these authors in the database will be time-consuming, so we'll need to move the data retrieval process to the nightly job. It shouldn't be a big deal since dates of birth/death change once every 24 hours by definition. Ahasuerus 23:48, 20 February 2017 (UTC)
That will give a huge preference to artists - they tend to have more works and the good ones have more awards. Not that I mind having some artists in the list but if the list gets nominated by artists, it will kinda be against what the DB is all about. Annie 23:57, 20 February 2017 (UTC)
True. It would also be biased against newer authors who haven't published many books/stories yet.
I guess we could add different weights or thresholds for different title types: you need to have more than N art titles to be included, but you only need M other types of titles to be included. Ahasuerus 00:05, 21 February 2017 (UTC)
We need to be careful for authors like Chiang for example - he has a limited number of stories and nothing else (no novels for example) but he does belong to the list. Although awards will probably get him into the list anyway. Annie 00:13, 21 February 2017 (UTC)
Even one award will be enough to get included, so he will be fine. Besides, he has close to 40 canonical titles, which will be plenty. Ahasuerus 00:22, 21 February 2017 (UTC)
And new and upcoming authors will almost never make it - or international ones - where we do not have a lot of their works... Maybe have a different rule for ISFDB minority language writers so they can make it in and for authors that had had works only in the last 2-3 years? Annie 00:13, 21 February 2017 (UTC)
The problem here is that we have no way of telling whether a non-English author has only one title on file because he never wrote any other SF or because we haven't cataloged his work yet. Ahasuerus 00:22, 21 February 2017 (UTC)
True but excluding them altogether is not a good idea either. Not sure how to solve that. Maybe reserve some number of spots for non-major language authors? At least this way we will have some non-major language presence...Annie 00:26, 21 February 2017 (UTC)
I guess the first question to answer is whether we are trying to make the front page a fair representation of:
  • what's in our database, or
  • worldwide speculative fiction
The former would be hard enough, but the latter would be much much harder.
Another thought. Do we really need to display these lists on the front page? They are nice to have, but they are hardly our "core competency". We could move them to a separate page and link them from the front page. If we do that, we don't need to limit the current lists. Or perhaps leave the top 10 authors on the front page and link to the full lists? Ahasuerus 00:50, 21 February 2017 (UTC)
You have something here. If we have only top 10 (or even top 5) and then a complete list (language-filterable if you feel like coding), that will be awesome. What I do not like is having a list that seems like a representation of the site that contains only English authors. Annie 01:13, 21 February 2017 (UTC)
I think the easiest way to do it would be to limit the front page lists to award winners. As long as there is at least one eligible award winner, that is -- February 29 can be problematic :-) Ahasuerus 01:39, 21 February 2017 (UTC)
Award winning authors who were born or died on Feb. 29th: Janet Kagan, Patricia A. McKillip, Tim Powers, Howard Tayler, Sharon Webb. That's 5 :-) Chavey 03:04, 22 February 2017 (UTC)
Winners and nominees for when the winners are not enough or none are there? There may be someone often nominated and never won still standing... As for Fen 29 - just make a date exception - if it is Feb 29, get top 5? :) Annie 01:43, 21 February 2017 (UTC)
I'll need to run a few queries to be sure, but I expect that we will need just two cases:
  • all winners and nominees whose birthday/anniversary of death is today
  • if none are found, the 5 people with the most titles
Ahasuerus 03:01, 21 February 2017 (UTC)
I cannot imagine a case (short of no one's birthday being on this day) that won't work with those two (if you do not want to give precedence to winners compared to nominations). Annie 03:14, 21 February 2017 (UTC)
As this would likely mean that for most days only award winners will be shown: likely neither Jules Verne, H. G. Wells, Franz Kafka or other of their contemporaries would show up. Stonecreek 04:56, 21 February 2017 (UTC)
Actually, H. G. Wells has a number of title-based nominations, so he would appear on the short list. Jules Verne has 5 nominations, but they are not title-based. We could check for matching author names, though.
However, I agree with your larger point. Any kind of automated algorithm which reduces the number of displayed authors from 30-50 to 5-10 is bound to be biased in some way. We can try to predict/identify the bias and adjust for it, but I don't think we can eliminate it. Awards are an imperfect indicator because there are many more awards now than in the past, but at least they are somewhat objective. Ahasuerus 05:14, 21 February 2017 (UTC)
I think we do need a list of creators who are displayed. This list would be filled with the criterions already stated: award winners/nominees and number of published works. I'd say both criterions should fill the list, and I propose a number of 7 works of fiction (or more?). That should be enough to downsize the number of displayed creators considerably. But we also need a list of eminent authors that would be left out: Mary Shelley or other early practitioners of the fantastic who didn't publish much but impacted on the genre. This list ideally should be moderated or would be accessible by moderators. Any comments? Stonecreek 12:04, 21 February 2017 (UTC)
Sorry to be blunt, but I've always felt that this list was completely useless. What's its intended purpose? (apart to have the pleasure to see your name in it once a year). Probably the relatives of the authors listed don't need us to remind their birthday. Hauck 19:08, 21 February 2017 (UTC)
A very good question indeed! I don't think there was any significance to the choice of author birthdays and dates of deaths when Al added them to the front page. As I recall, we just needed to put something on the front page that would change daily. Forthcoming books and author birthdays seemed like a good choice. The rotating banner was added around the same time.
As I mentioned earlier, I don't think they are our "core competency", but they have apparently become associated with the ISFDB -- or at least I have seen a lot of online discussions which mentioned them. It's really the only reason why I would be hesitant to replace them with a link to a separate Web page. Ahasuerus 19:27, 21 February 2017 (UTC)
Well for me (and I'd think for many others) it has the charm to find some new authors and even more to remind me of nearly forgotten ones. I do think it is one of the things that makes ISFDB special (and regardless of any condensed list, I'll try to maintain the long list: if there are more than 500 names on it per day, I'll likely revise this). Stonecreek 20:04, 21 February 2017 (UTC)

(unindent)Well, if the problem is what to put on this page, perhaps a kind of "last entered publications" may be a good candidate to 1) showcase our contributor's efforts and 2) give a casual browser the full breadth of our coverage. Hauck 08:12, 22 February 2017 (UTC)

Now, that's an interesting thought! We already have this publicly available list of recent edits which links to updated records. Perhaps we could:
  • limit the birthday column on the left to 10 award-winning and "marque" authors
  • display a link to the full list of people who were born and died on this date
  • replace the list of authors who died on this date (some users find it too morbid) with a list of the last 10 edited records
 ? Ahasuerus 15:20, 22 February 2017 (UTC)

(unindent) One thing to consider is that the front page already handles a similar issue. Every month, hundreds of new publications are released. However, the front page displays just 22 pubs, a small subset of what's out there. They are called "Selected Forthcoming Books". The list of all forthcoming books is linked to from the front page.

How does the software that generates the front page decide which 22 publications to display? It limits the list to "marque" authors. How does it choose the "marque" authors? Every time a user views an author's bibliography, the software increments that author's "view" counter. That counter is then used to generate the Most Viewed Authors Since 2005 report. Every January a bureaucrat runs a special script which checks all of the "view" counters. The top 2% of all authors are marked "marque". The process is completely automated, objective and doesn't require additional human input.

Since the "marque" data is already available and used on the same Web page, we can leverage it to select the subset of authors to be displayed and then link to a separate Web page which will display the full lists. Ahasuerus 15:10, 21 February 2017 (UTC)

But would this also take regard of important French, Bulgarian or other non-English language authors? Also, it could be of interest to display artists like Hieronymus Bosch who certainly inspired great amounts of fantasists. Nevertheless your idea is certainly better than the long list we have right now. Stonecreek 16:26, 21 February 2017 (UTC)
If it counts each click regardless of who does it, it may propel the Bulgarian ones to the top of the list in some days - the way I am checking on them sometimes :) More seriously though - maybe a mix between a currated list and the marque authors will do. The more international works and updates we get, the more clicks we will get on the non-English ones. Plus the full list will contain them all. Annie 16:34, 21 February 2017 (UTC)
I am concerned that a manually maintained/curated list of "important authors" would cause even more problems than the (in)famous "threshold". We all have different ideas about who is important and who isn't, so there is liable to be controversy. In addition, it will require continuing tweaking as the field evolves. Consequently I believe that objective criteria would serve us much better.
I can think of three objective criteria which we could use singly or jointly to promote "selected authors" and "selected forthcoming publications" to the front page:
  • The "marque" flag as discussed above; it's already being used by the "forthcoming publications" display logic
  • Awards and nominations
  • Total title count or possibly the count of certain title types, e.g. fiction
The last two criteria are computationally intensive, so we will need to move the selection logic to a nighty job to be run at midnight. As I mentioned previously, it won't be a big deal programming-wise. I also think that we should use the same selection criteria to select both authors and publications in order to be consistent. Ahasuerus 18:08, 21 February 2017 (UTC)
You're right about the differences about who is important, so I'd be okay with the criteria mentioned. Stonecreek 20:04, 21 February 2017 (UTC)
This is kind of tangential, but if the DOB/DOD is going to be reworked, it seems to me that the DOD should be sort by DOD, rather than the DOB as it is now.--Rkihara 20:06, 21 February 2017 (UTC)
I am not sure I care too much about this but to throw a little something on this fire, how about quantifying authors by counts of translations of their works (as a measure of how widespread the body of their work is since we cannot count books sold, etc.). That is an interesting (if not the only) measure of how important an author is seen by the the world at large (it is not without its flaws though of course). Uzume 01:11, 25 February 2017 (UTC)
I like the idea in principle but we have so little non-majority languages (statistics books added that it will be almost meaningless at this point :( Annie 01:16, 25 February 2017 (UTC)
True, it is sad we have more Ancient Greek titles than Arabic ones. Uzume 01:39, 25 February 2017 (UTC)
The old requirement to enter transliterated/romanized author names was a big disincentive for anyone who might have been interested in entering works in non-Latin languages. Hopefully things will pick up as we improve our multilingual support. Ahasuerus 02:09, 25 February 2017 (UTC)

Title date display

Based on the outcome of a recent discussion, the Title page and the "Diff Publications" page have been changed to display the exact date of the title in the "Year" field. (There is another FR to change the word "Year" to "Date".)

Next question: is the current abbreviated date format used in the "Date" column of the Title page OK or should we use the YYYY-MM-DD format instead? For example, this page displays "Mar 2016" instead of "2016-03-15", "Feb 2017" instead of "2017-02-21", etc. Ahasuerus 15:57, 21 February 2017 (UTC)

For me, "Feb 2017" (the month of a certain year) is absolutely sufficient. Stonecreek 16:28, 21 February 2017 (UTC)
If we have the actual date recorded, I'd rather see it without the need to go down into the publication. Annie 16:54, 21 February 2017 (UTC)
I do like it this way with the month in words. But making it "2 Mar 2010" would be just as good. --Vasha 18:19, 21 February 2017 (UTC)
Why not have both using hover over popup concept taken from transliterations? One issue to consider about date formats is internationalization and localization. "2010-03-02" is the same as "2010年3月2日", "2 Mar 2010", and "March 2, 2010". This is why I prefer the YYYY-MM-DD (ISO 8601) format we use elsewhere. I would prefer a unified style (why do we use "2 Mar 2010" on author birth and death dates but "2010-03-02" on title and publication record dates?) if we do not support a user selection option. Uzume 01:25, 25 February 2017 (UTC)

My Errored Out Edits

This was a feature introduced in 2015 as described here. This also seems to be about the only documentation of the feature. A recent submission ended up there, and some of the edits were incorporated, but others were not. In this case, it seems that the notes and contents updated, but not the reviews. As a non-moderator - what is my role at this point? Do I resubmit the reviews? Do I wait? Doug H 19:05, 21 February 2017 (UTC)

Please add the Contents titles which didn't make it. It looks like the MIA titles include all of the regular reviews and 2 reviews-entered-as-regular-titles, right?
On the technical side, I will be able to copy the errored out submission to the development server tomorrow morning. I will then try to re-approve it and see if it generates an error. Once we know what it is, we should be able to fix it. Ahasuerus 19:14, 21 February 2017 (UTC)
That seems correct. I'll resubmit later this evening. Doug H 21:59, 21 February 2017 (UTC)
Resubmission worked. Looks like the second last ESSAY review partially succeeded - title/author but not the page number. So I'm good on this. Priority is your call. Doug H 13:28, 23 February 2017 (UTC)
Sounds good. I am in the process of restoring the latest backup file on the development server. We'll see what happens when I try to re-approve the submission. Ahasuerus 15:26, 23 February 2017 (UTC)
After installing the latest version of the database on the development server, I tried to restore the data to the state that it had been in prior to the submission approval. I then re-approved the submission. Unfortunately, it didn't result in an error, so we are still in the dark :-( Ahasuerus 21:59, 23 February 2017 (UTC)
Ah, but at least I can pretend it's not my fault. Doug H 16:34, 24 February 2017 (UTC)

Order of story length options

Undecided discussion from here: should the dropdown list of lengths be in increasing order (I vote yes) or stay as it is? --Vasha 21:08, 21 February 2017 (UTC)

I like the current order - less likely to confuse the two similar sounding ones. Annie 21:14, 21 February 2017 (UTC)
Me too. Keep it as it is please! PeteYoung 22:38, 21 February 2017 (UTC)
If excerpt got added to the mix it would be hard to "sort" that with the others. Uzume 01:28, 25 February 2017 (UTC)
I think you may be the only one who likes the idea of "excerpt" being a length... everyone else was talking about it being a title type --Vasha 01:32, 25 February 2017 (UTC)
That was not how I read things (but perhaps I misunderstood). As title type seems that seems problematic. As a length, I could usefully apply it to essays and nonfiction (like an excerpt of a bibliographic index, etc.) as well. Uzume 01:43, 25 February 2017 (UTC)
I read it as a support for Length as well :) However to your latest point here: length may be showing when you are working on publications for all titles but if you read the documentation and look at editTitle for example, it is valid only for Short Fiction. Making it usable elsewhere will probably require a lot of other changes (even if it becomes a length). Annie 01:46, 25 February 2017 (UTC)
Taking this discussion back up to the proper section now --Vasha 02:10, 25 February 2017 (UTC)

Sheree R./Sheree Renée Thomas

Would there be any objection if I switch the canonical name from Sheree R. (four publications) to Sheree Renée (eighteen publications)? I'm just about to add a collection with dozens more items under the latter name. --Vasha 03:27, 23 February 2017 (UTC)

Sounds like a plan. It looks like she changed her working name ca. 2005, but we never updated her canonical name. Ahasuerus 03:35, 23 February 2017 (UTC)
Looking at my email with her, that's the name she's used in all professional settings since at least 2011. Chavey 03:58, 23 February 2017 (UTC)
OK, pseudonym and variant changes submitted. Ready to delete empty titles as soon as those are approved. --Vasha 04:00, 23 February 2017 (UTC)

Cleanup reports: Language-specific title reports

As you know, we are nearing the completion of the language assignment project or at least its title part. Language-less titles are becoming extinct and will be gone in a few days. It will still be possible to create a title without a language during certain unusual Edit/Clone Publication operations, but it will be rare. For this reason, I have folded the "Titles: Languages" section of the cleanup reports menu into the general "Titles" section. Ahasuerus 00:17, 24 February 2017 (UTC)

You may want to change the text in that report from "No eligible container titles without a language found." to "No titles without a language found." Annie 00:41, 24 February 2017 (UTC)
Will do, thanks! Ahasuerus 01:05, 24 February 2017 (UTC)
Fixed. Ahasuerus 01:44, 24 February 2017 (UTC)

Authors without a language

Once all of the title records have had a language assigned, the next step will be assigning a "working language" to our author records. Here is the current breakdown:

| A    |     2292 |
| B    |     5692 |
| C    |     4931 |
| D    |     3249 |
| E    |     1366 |
| F    |     2431 |
| G    |     3402 |
| H    |     4754 |
| I    |      401 |
| J    |     1624 |
| K    |     2816 |
| L    |     3382 |
| M    |     6200 |
| N    |     1197 |
| O    |     1039 |
| P    |     3253 |
| Q    |      159 |
| R    |     3386 |
| S    |     6670 |
| T    |     2360 |
| U    |      194 |
| V    |      816 |
| W    |     3764 |
| X    |       23 |
| Y    |      388 |
| Z    |      381 |

I think it would be best to create a cleanup report covering a few letters to see how many are not English. If the answer is "0", then we can safely auto-assign "English" to all of them. Ahasuerus 00:39, 24 February 2017 (UTC)

The answer will be "at least 1 in whatever letter we select" just to make things hard. At least if the titles were any indication... Can we get the pseudonyms cleared before we start manual inspections at least? :) Annie 00:43, 24 February 2017 (UTC)
Oh yes, pseudonyms. Sorry, it slipped my mind. I will see what I can whip up. Ahasuerus 01:04, 24 February 2017 (UTC)
There are 3,326 pseudonyms without a language even though their canonical name has a language code on file. Of that number, 233 canonical names are not English. I'll create an auto-assignment script later today. Ahasuerus 16:28, 24 February 2017 (UTC)
All eligible pseudonyms have been auto-assigned. The table above has been updated with the new counts. Ahasuerus 18:14, 24 February 2017 (UTC)
I hoped we will win more than that. On the other hand, 3,326 that won't need manual check are better than 0. Shall we proceed with a cleanup report of a letter or two and see how it looks like? I might as well keep my "language-challenged elements rescue" hat a bit longer and help with this one... :) Annie 18:37, 24 February 2017 (UTC)
Sounds like a good plan. Should we start with the letters X, Y and Z? :) Ahasuerus 18:49, 24 February 2017 (UTC)
Why not even though we will do our best not to have even a quasi-war with our French, right? :) Annie 18:53, 24 February 2017 (UTC)
The XYZ affair was mostly about (attempted) bribery. Strangely, no one has tried to bribe us yet! :) Ahasuerus 19:07, 24 February 2017 (UTC)

(unindent) OK, a new cleanup report has been created. The "XYZ" authors will become available tomorrow morning. A cursory review suggests that a significant number of artists' last names will be of Japanese or Chinese origin. Of course, as we all know, it can be hard to tell what the working language is when dealing with artists. Ahasuerus 20:29, 24 February 2017 (UTC)

Quick question - is there a moderator report somewhere that identifies pseudonyms and main authors that are assigned different languages? And if not, can a check be done to see if we have any couples like that? Annie 21:00, 24 February 2017 (UTC)
Not at this time. Checking the database I see that we have 53 [edit: 47] mismatches. Some of them are legitimate, e.g. Gregory Kern, but most aren't. Let me see if I can create a new cleanup report and allow moderators to ignore mismatches. Ahasuerus 21:12, 24 February 2017 (UTC)
Yeah, there will be a few legitimate but sometimes when the pseudonyms are connected late, there are real mismatches. Annie 21:42, 24 February 2017 (UTC)
OK, the report has been coded and deployed. It's moderator-only since (a) it lets you ignore records and (b) there are only 47 mismatches to process. Ahasuerus 22:21, 24 February 2017 (UTC)
Expected that to be the case. Someone will hopefully get to it. :) Annie 22:29, 24 February 2017 (UTC)

(unindent) So... what are we doing with authors like this one and his co-author. He wrote in Kaqchikel which we do not support... Annie 21:18, 27 February 2017 (UTC)

Well, it is easy to implement a new language; we have added quite a few over the last 5+ years. My only concern is that Kaqchikel is not listed by ISO 639-2 (available on this Library of Congress Web page) and we use a subset of their language codes. It's basically our way of outsourcing various issues associated with languages -- e.g. is X a language or a dialect? -- to an established third party. I guess we were liable to run into a language not listed by ISO 639-2 sooner or later... Ahasuerus 23:41, 27 February 2017 (UTC)
Actually it is there - just hiding. It is one of the Mayan languages - so maybe we should implement "myn" (ISO 639-2 collected them all together due to their obscurity) and we will need to add a note to which one it is into the author page? Annie 23:48, 27 February 2017 (UTC)
PS: ISO 639-3 has it on its own but I do not think we need to go that deep... Annie 23:49, 27 February 2017 (UTC)
Thanks for looking it up! This is a pretty good example of the challenges created by choosing between ISO 639-2 and ISO 639-3. Kaqchikel (aka "Cakchiquel" and a bunch of other spellings) is not directly supported by ISO 639-2. On the other hand, ISO 639-3 has codes for "Cakchiquel, Central", "Cakchiquel-Quiché Mixed Language", "Cakchiquel, Santa María De Jesús", "Cakchiquel, Southern", "Cakchiquel, Acatenango Southwestern", etc. In other words, ISO 639-2 is too little and ISO 639-3 is too much for our purposes. Perhaps there is a happy medium that I am unaware of because I am only peripherally familiar with these standards.
In this particular case I am tempted to go with "cak" for "Cakchiquel" (listed as "Cakchiquel, Central" by ISO 639-3), but I am concerned about establishing a precedent. Ahasuerus 00:11, 28 February 2017 (UTC)
I vote for going for "myn" - it is how it gets identified under ISO 639-2 anyway (in its group) AND add bibliographic notes(which one day will get migrated). Otherwise I am worried about precedents as well. Maybe keep notes and when we see more of these cases, we can discuss moving to 639-3?Annie 00:26, 28 February 2017 (UTC)
OK, I have created an FR. I will put it on hold for a bit in case there are other opinions. Ahasuerus 01:55, 28 February 2017 (UTC)
Done. Ahasuerus 21:18, 2 March 2017 (UTC)

2017-02-23 site slowdown

Response time was pretty bad around 7:45pm server time. There were a lot of additional users hitting the site all at the same time. I am not sure what had brought them here, but they appear to be gone now. Perhaps the slashdot effect. Ahasuerus 01:03, 24 February 2017 (UTC)

Year -> Date

All occurrences of the word "Year" have been replaced with the word "Date". The changes affect all bibliographic pages, edit pages, mouse-over Help bubbles and Wiki-based Help. They do not affect the way field names appear on moderator review pages due to certain technical issues which would take a huge amount of time address. Also, "Award Years" are still "Award Years" -- until someone starts giving monthly or daily awards :-)

If I missed anything, please let me know. Ahasuerus 01:32, 24 February 2017 (UTC)

Additional occurrences of "Year" have been identified and corrected. Ahasuerus 15:30, 24 February 2017 (UTC)
What about those in Advanced Search drop downs? Uzume 01:53, 25 February 2017 (UTC)
I think we are fine there. "Title Year" and "Publication Year" require YYYY values. Similarly, "Title Month" and "Publication Month" require YYYY-MM values. Ahasuerus 02:06, 25 February 2017 (UTC)
I was thinking more of the sort fields like title search sort by year and pub search sort by year. Uzume 02:37, 25 February 2017 (UTC)
Good point - fixed. Ahasuerus 19:57, 25 February 2017 (UTC)
BTW, pub search results still show things like "Sep 1999" in "Date" column whereas title search shows things like "1997-00-00" in the "Date" column. Uzume 02:37, 25 February 2017 (UTC)
Thanks, I'll create a bug report. I have tweaked a few pages to make dates more consistent (see earlier discussions and patch notes), but there is a fair amount of inconsistency left. Ahasuerus 19:57, 25 February 2017 (UTC)
Fixed. Ahasuerus 20:53, 25 February 2017 (UTC)

Redesign of the Verification Status Panel

I think we need to revisit the design of verification status panel to account for inactive verifiers. There are presently five primary verification slots and for many pubs these are completely filled. The majority of primary verifiers in many cases are inactive. I propose that inactive primary verifiers should be removed as primary verifiers and moved to side under the heading of Inactive primary, thus opening up the slots for the active verifiers.

I would also like to propose that a “manually entered” change history page be linked to each verified pub. With up to six verifiers, including transient, it’s difficult to know who to notify if a change is made, and the post clutters up the verifier’s talk page.--Rkihara 18:32, 24 February 2017 (UTC)

There is a Feature Request to "Re-do primary verifications":
  • The verification page is to be split into three sections
  • The top section of the Web page will be for the currently signed-in user's primary/transient verification. If the user has not verified the pub, this section will give the user the following choices:
    • Primary-verify the pub
    • Transient-verify the pub
  • If the user has already verified the pub, he will be given the following choices:
    • Remove his verification
    • Change the verification type from Primary to Transient or vice versa depending on the type of the current verification
  • The middle section will display other users' primary verifications. The currently signed-in user will not be able to change them.
  • The bottom section will display secondary verifications. They will be displayed using the current table using the current layout and the current functionality.
This FR was listed on my short list of things to implement in 2017 and received more support than the rest of the FRs. Ahasuerus 18:46, 24 February 2017 (UTC)
Looking forward to it!--Rkihara 19:35, 24 February 2017 (UTC)

"Interviewed Author" added to Advanced Title Search

"Interviewed Author" has been added to Advanced Title Search as a selection criterion. Ahasuerus 20:36, 25 February 2017 (UTC)

Publication formatting

The way publication dates appear in our standard publication listings -- the table format used by the title page, the publication series page, Advanced Search results, etc -- has been changed to be consistent with the standard title table. In order to accommodate this change, the "Date" column was made slightly wider at the expense of the "Author/Editor" column. If the table layout doesn't look quite right, please do a full page reload (Control-F5 in most browsers) which should refresh the formatting information used by your browser. Ahasuerus 20:59, 25 February 2017 (UTC)

Advanced Title Search - simultaneous use of Synopsis and Notes

Advanced Title Search has been modified to support specifying Synopsis and Notes search values in the same search. Ahasuerus 21:12, 25 February 2017 (UTC)

Enhancing Advanced Search

Advanced Search is a useful tool, but it has a couple of issues.

First, some searches take a long time to complete. Not only is it an annoyance for the user who requested the search, but it can also affect other users if the Advanced Search locks certain parts of the database until it's done.

Second, the ability to specify a combination of AND and OR search conditions can be ambiguous. For example, if you select:

  1. "Title contains 'Star'", AND
  2. "Title Type is exactly NOVEL", OR
  3. "Title Tag contains 'juvenile'"

in Advanced Title Search, should the system search for:

  • (condition 1 AND condition 2) OR (condition 3)


  • (condition 1) AND (condition 2 OR condition 3)

? (For the record, it uses the latter algorithm.)

It so happens that these two problems have the same root cause, namely the fact that we allow a combination of "AND" and "OR" conditions. If we were to limit each Advanced Search type to either all "ANDs" or all "ORs", we could resolve these two problems relatively easily. You would still be able to search for "condition A AND condition B AND condition C" or for "condition A OR condition B OR condition C", but not for "condition A AND condition B OR condition C".

Given the ambiguous nature of mixed AND/OR searches (see above), I don't think it would be much of a sacrifice. Does anyone rely on mixed AND/OR searches? Ahasuerus 00:30, 27 February 2017 (UTC)

OR gets a precedence to AND? That's interesting... I would have assumed the opposite. Or is it just always executing right to left, considering them the same order, regardless of what the operator is (so C1 OR (C2 AND C3) as opposed to (C1 OR C2) AND C3)? Annie 18:42, 27 February 2017 (UTC)
I am not sure it's consistent. I'd have to dissect the SQL queries that the Advanced Search software generates. Ahasuerus 20:22, 27 February 2017 (UTC)
Having a mixed case is useful in some cases (as long as you know how it will work after all - once you know the precedence, you can write your query properly after all. If the price for performance improvement is losing the mixed case, then sure, cut it. But if there is a way to keep it (only getting called when there is a real mix of And/or), I'd like to still have the option. Annie 18:42, 27 February 2017 (UTC)
I too think mixed is very useful (but tricky to program I am sure). I think fixing the code to be consistent and documenting the order would be good. I recommend just always doing: ((A op1 B) op2 C). If someone wants a different order you can craft it the other way around this way you can have any of (A AND B) AND C, (A OR B) OR C, (A AND B) OR C, (A OR B) AND C. Meaning, just make the first operator the precedence and document that (it is simple and gives you both options, albeit with some work for the search/query crafter). Uzume 21:33, 27 February 2017 (UTC)
Unfortunately, the way our version of the MySQL optimizer works, mixed AND/OR cases can take a very long time to complete. Some of the odder queries that I have run on the development server took well over a minute (sic) to finish. They may be somewhat faster on the live server for obvious reasons, but even 20-30 seconds is way too long for a query to run, especially given its potential impact on other users.
(Puts his technical hat on.) The only way (that I know of) to address the issue with complex ORs in MySQL 5.x is to switch to UNIONs. I'll have to toy with the query generator to see if we can do it while still supporting mixed AND/OR queries. Ahasuerus 22:06, 27 February 2017 (UTC)
How about splitting them - inspect the query before you run it -- if it is mixed, then go the long way; if it is not (go the easy way - provided that we do not do that already). Add a warning at the top of the page that mixed queries are going to be slow and be done... Now - if the concern is that such a query can slow everyone else down, then maybe make it available only to logged in users? Or disable it until a better solution is found. Annie 22:13, 27 February 2017 (UTC)
I don't use OR, but I could use NOT.--Rkihara 23:11, 27 February 2017 (UTC)
Way back "AND NOT" was supported along with "AND" and "OR". However, it could cause serious performance problems, so we disabled it. It happened a long time ago and the Advanced Search software has changed quite a bit since then. The Feature Request to fix and re-enable "AND NOT" was creates in 2007. Depending on the outcome of the current discussion, we may be able to re-enable "AND NOT". Ahasuerus 23:27, 27 February 2017 (UTC)
AND NOT would be very, very useful. More so than mixed AND/OR. But possibly if you found a performance-friendly way to implement one, it would allow the other, too.
As a last-ditch option, maybe there could be a page for logged-in users to submit a complex search query to be run during daily update time (scheduled slowdown time)? --Vasha 12:58, 28 February 2017 (UTC)

Rie Sheridan (Rose)

I would like to switch Rie Sheridan's canonical name to Rie Sheridan Rose, which she's been using since 2008 (and recently republished the old stories under the new name), since we now have more titles under the new name. --Vasha 12:30, 28 February 2017 (UTC)

Sounds reasonable. Unfortunately, there is no way to do a mass change, so it will have to be done one title at a time. Ahasuerus 19:55, 28 February 2017 (UTC)
Working on it now. --Vasha 21:11, 28 February 2017 (UTC)

"Shortfiction" section title

Shouldn't the section title "Shortfiction" on summary pages be changed to "Short Fiction"? There's already "Short Fiction Series". --Vasha 13:09, 28 February 2017 (UTC)

I agree. I also think that we should change "shortfiction" to "short fiction" on Publication pages. Ahasuerus 14:49, 28 February 2017 (UTC)
Makes sense to me. Albinoflea 16:58, 28 February 2017 (UTC)
I vaguely remember asking for a change of this earlier so I still support it :) Annie 19:09, 28 February 2017 (UTC)
Done. Ahasuerus 19:54, 28 February 2017 (UTC)

Changing the front page

As we discussed earlier, the list of authors born today is becoming longer and longer. It's up to 70+ authors now and will only get longer as we enter more DOBs.

Based on the last discussion, here is what I propose we do:

  • Create a new Web page which will show a list of all authors who were born/died on this date
  • Limit the left column ("Authors Born On This Day") to a list of 10 people born on this day
  • The list of 10 people will include award-winning/nominated authors as well as "marque" authors, i.e. the most viewed authors in the database (2%)
  • Display a link to the new page which shows all authors born on this day (see above) in the left column
  • Replace the right column ("Authors Who Died On This Day") with a list of most recently edited records. It will contain the first 10 values from the "Subject" column of the Recent Edits list.
  • Display a link to the full list of "Recent Edits" in the right column

How does it sound? Ahasuerus 01:36, 1 March 2017 (UTC)

I really do not see the value in this. As discussed, every heuristic has its flaws and though the list is now larger, it is relatively small (in terms of bytes transferred; I concede it takes up consider screen real estate vs. bytes transferred). If the screen real estate is the issue, why not just move those sections down below the "Selected Forthcoming Books" section. That way it is still there but way "below the fold" when viewing the page and one has to scroll to get there (meaning still there but less prominent). I thought I would note approximations of these lists can be generated with advanced searches like: Birth 03-01 and Death 03-01 Uzume 16:49, 1 March 2017 (UTC)
I think a smaller list of birthdays would in fact be more interesting. The long list doesn't catch the eye; people would be more likely to read it if it was shorter, and if the first few names included someone familiar. They'd note the familiar ones and maybe click through to the one or two they didn't know. --Vasha 18:38, 1 March 2017 (UTC)
If we are considering pushing the larger list to a separate page, why not make it more of a date-based author directory (meaning one can see such lists not only for today but also for other days and perhaps have it navigable via a calendar of sorts). We might even have links into these pages (I can possibly foresee links from authors birth and dates to these labelled things like "Other authors born the same day" and "Other authors who died the same day"). Uzume 18:46, 1 March 2017 (UTC)
We can certainly create an additional Web page which will look like a calendar. Clicking on one of the 366 choices will take you to a list of authors who were born/died on that day. Ahasuerus 20:15, 1 March 2017 (UTC)
I love that idea. :) Annie 20:35, 1 March 2017 (UTC)
FR 998 has been created. Ahasuerus 19:23, 3 March 2017 (UTC)
Sounds okay for me, except that I think the list of "Authors Who Died On This Day" would pair more graceously with the list of birthdays. Maybe it would be possible to feature the list of recent edits more prominently (analogous to the list for all birthdays). Stonecreek 20:01, 1 March 2017 (UTC)
I think there is enough real estate on the front page to keep the two author columns and add a third one for recent edits. OTOH, there have been complaints (both here and elsewhere) about the "Death" column being too morbid to appear on the front page. At one point someone even requested a user preference to hide this column. Ahasuerus 20:19, 1 March 2017 (UTC)
Well, as someone that prefers smaller screens on her desktops and laptops and with all the people using tablets and phones (I do the latter to edit now and then but I am not expecting to see everything well), I would be careful with adding more columns. Annie 20:35, 1 March 2017 (UTC)
It would be also nice to have a special representation in case an author's birthday happens to be 50, 100, 150, 250 years ago (regardless of prominence or awards). Stonecreek 20:01, 1 March 2017 (UTC)
That's a good point. We'll have to think of the best way to implement it. Ahasuerus 20:20, 1 March 2017 (UTC)
I like the proposals, especially the new list of recent edits, because that way the occasional user can immediately see if and how the site is still active. The "calendar" mentioned above is a nice idea, however it should be of low priority compared to other new features. Jens Hitspacebar 21:12, 1 March 2017 (UTC)
Here's the way I organized it for the speculative fiction portal on Wikipedia. There are additional items, too, but this should convey the general idea. ···日本穣 · 投稿 · Talk to Nihonjoe 21:23, 1 March 2017 (UTC)
Gets my vote!--Rkihara 18:59, 2 March 2017 (UTC)
That is exactly what I meant and yes it could be expanded to include things like awards (Person X won the A award for work W today/specifc day Y years ago, type of thing), and birth and death anniversaries as well, etc. They could be sorted by age (and possibly grouped in increments like 25 years or so), etc. I do not really see the need for the change to the front page (though it could be reorganized moving such parts down if it bothers people) however if the birth and death dates do get removed (or restricted to notable by some heuristic) from it, I believe it should be either totally disposed of (and just made into search links as I mentioned above) or expanded in the calendar directory fashion. Uzume 20:01, 2 March 2017 (UTC)
I still think that we should have a "representative sample" on the front page. A calendar is a good idea but removing the list from the page altogether just does not sound right :) Annie 20:08, 2 March 2017 (UTC)
You can see how the SF portal is organized here. Maybe that will give some ideas on organization? ···日本穣 · 投稿 · Talk to Nihonjoe 21:33, 2 March 2017 (UTC)
I've seen it. :) I find it overloaded and containing so many things that you cannot find anything. I like our much smaller and cleaner (and with a lot more white space) one a lot easier on the eye and a lot more likely to have something that catches my eye. It needs to be like that I guess - because of the scope but turning ours into something like that will be a bad move in my opinion. Annie 21:49, 2 March 2017 (UTC)

(unindent) Outcome: FR 999 has been created to reflect the originally proposed design. Once it has been implemented, we can tweak what is displayed in the columns. Ahasuerus 19:23, 3 March 2017 (UTC)

Mayan languages added

"Mayan languages" have been added to the list of supported languages. Ahasuerus 21:19, 2 March 2017 (UTC)

Yey! I will go and fix the two authors that need it. Annie 21:43, 2 March 2017 (UTC)

Standardizing "Edit" links

"[Edit]" links were added to the bibliographic pages a few weeks ago. They are currently displayed as regular HTML links in square brackets. At the same time we display the link that takes you to the tag editor ("or manage Tags"), the "VOTE" link, the "view full Note" link and the "View all covers" link using a special "inverted" font. See Garan the Eternal for an example of a title page that uses all 4 links.

Should we standardize the appearance of these links? If so, should we use the regular link format or the inverted one? It's a trivial change either way, we just need to decide what we want these links to look like. Personally I think that the "inverted" font looks spiffier. Ahasuerus 21:45, 2 March 2017 (UTC)

Now that you mention it, having the edit link in the inverted form would look good. But the location is right I think. (BTW, out of curiosity, how often does the "Vote" function get used?) --Vasha 21:51, 2 March 2017 (UTC)
According to the ISFDB Statistics page, 9,311 (or 0.72%) titles have votes associated with them. Ahasuerus 21:59, 2 March 2017 (UTC)
I prefer the standard links - it took me a bit to actually realize that the inverted font meant links when I joined. Annie 21:53, 2 March 2017 (UTC)
As I recall, some other editors have run into this problem a well. Hm... Ahasuerus 22:00, 2 March 2017 (UTC)
Seems quite obvious to me (and also a good way of visually distinguishing functions, versus links to data pages which are ordinary links), to add a data point in the opposite direction. --Vasha 22:18, 2 March 2017 (UTC)
I must be particularly dense. What is an inverted link font anyway? Anyone care to explain (Annie's comment about "links when I joined" does not really help me and I joined ISFDB years ago). Uzume 01:43, 3 March 2017 (UTC)
The links that look like they are highlighted in blue (blue background, white letters). Look at the link from Ahasuerus above - there are a lot of them. Annie 01:50, 3 March 2017 (UTC)
The links that I mentioned earlier use a blue background. The CSS definition is a follows:
.inverted {
   font-size: 90%; 
   background: #00f;
   text-decoration: none;
   padding-left: 5px;
   padding-right: 5px;
I now understand, what is meant is the CSS class named "inverted" which has colors that apparently seem inverted from other links (I do see them as white on blue). Thank you. Uzume 02:34, 3 March 2017 (UTC)

I cannot agree on how spiffy such links appear, however, I do agree it makes sense to differentiate action links from normal navigational data links (which should likely be persistent and externally linkable; action links like edit and vote, etc. require a login and need not be persistent so could be renamed and moved in URL space). Uzume 05:04, 3 March 2017 (UTC)

Two new title types to implement

There seems to have been general acceptance of the idea of creating new title types for scripts and fake essays (what to do about excerpts, on the other hand, remains uncertain). I think they would be easy to implement -- almost all existing examples of scripts could be found by searching notes, and as for the essays, some creative searching could find them too. The only thing left to decide is what to call them. I suggest "script" and "fictive essay" (not "fictional"). --Vasha 23:23, 2 March 2017 (UTC)

"In-universe essay", perhaps? Ahasuerus 23:49, 2 March 2017 (UTC)
It ought to include things like Álvaro Menén Desleal writing a preface for his own collection of stories and signing it Jorge Luis Borges, which was intended and received as a joke between fellow South American spec fic writers. Borges was himself a writer of metaliterary pieces like the "Chronicles of Bustos Domecq", so does that make Desleal's essay somehow, some way, in-universe? --Vasha 00:41, 3 March 2017 (UTC)
The Contento1, Locus, Miller/Contento and FictionMags sites use "facetious article" with the abbreviation "fa". For scripts, they use "play" with the abbreviation "pl". FictionMags specifically states that play is meant to include scripts of films, radio and tv episodes. Their full list of types is here. I haven't done a full compare, but I believe that these databases (three of which are our standard secondary verification sources) essentially use the same set of title types. --Ron ~ RtraceTalk 00:50, 3 March 2017 (UTC)
"Facetious" suggests humorous intent which isn't necessarily the case; for instance, an introduction to the world of a fantasy series written as a supposed excerpt from a guidebook. --Vasha 00:58, 3 March 2017 (UTC)
For reference, "comic book" also suggests humorous (the Japanese word "manga" also has similar comical meaning) but methinks that term is well entrenched in English now (though we tend to use "graphic novel" here). Within some of the works of the Gor series written by John Norman, a pseudonym developed by the real author, are envelope notes. I believe this is mostly within the earlier works of the series but I know one example is Outlaw of Gor (I happened to have a copy on hand for reference) which has a leading "A Note on the Manuscript" and "A Concluding Note on the Manuscript" which are signed by John Norman and explain how he came to get the material from a lawyer friend named Harrison Smith without actually meeting the main character of the novel, Tarl Cabot. Further in that novel, the first chapter entitled "The Statement of Harrison Smith" is purportedly by the lawyer friend. The rest of the novel uses the first person to refer to the main character Tarl Cabot. I suppose these pieces of the novel might qualify under this proposed fake essay/facetious article title/work type, however, I am not convinced we need to separate these novel pieces as separate works (anymore than we denote all the chapters of a novel here). If we do in fact include such such a new title/work type, we need to be clear when it should be invoked. Frankly, I would rather we had another title checkbox or the like (similar to graphic and non-genre) to denote such things instead of a new title type (then it could be applied to any fictional title type that applies). In a similar fashion I prefer making excerpts a length. I see no issue adding a script/play title/work type and see it much as our current poem title/work type. Uzume 02:24, 3 March 2017 (UTC)
I believe there are two separate questions here. The first one is which framing stories and in-universe essays need to be entered as separate titles. The second one is how we want to enter the ones that should be entered separately. The current proposal deals with the second question only.
Making "fictive" a check-box on the Edit Title page is an interesting idea which hasn't been suggested before. Something to ponder... Ahasuerus 03:21, 3 March 2017 (UTC)
I fully agree. The point was to think about things as considering how we want to use something often influences how we want to and ultimately how we implement them. Uzume 05:49, 3 March 2017 (UTC)
Well, for what it is worth I needed a dictionary for the word "facetious" a few months ago when I crashed into our sources for the first time while looking for something. If we use this, a lot of international contributors will be a bit lost - the system is already complicated (EDITOR is already a challenge and it is technically never added manually; this one is something people need to be able to select from a list... I understand that it may be the standard but can we come up with something that does not require someone to look up the meaning of - not everyone had even heard of our sources; and even when they had, understanding what this type is when one had not seen a US magazine that contains them is a bit hard. I like "In-universe essay" - it is clear enough so someone seeing it on a list can recognize a piece of writing as being one of those. Just my 2 cents. Annie 16:59, 3 March 2017 (UTC)
Yes, seriously. "Facetious article" may be acceptable as insider jargon, but since this database is aimed at casual users, we need to pick a less bewildering expression. --Vasha 17:10, 3 March 2017 (UTC)
I still don't see the need to implement a new title type for 'fictional essays': if it's in-universe it is fiction, however 'serious' the overall tone may be, if it is rooted in reality it is non-fictional, and as such an essay (ESSAYS being the little offsprings of NONFICTION, SHORTFICTION the ones of longer works of fiction, i.e. NOVELS). Why make it complicated if it can be quite easy?
A 'script' or 'play' title type would be nice, though. Stonecreek 18:52, 3 March 2017 (UTC)
I agree with Christian about the first type, it's useless. The plays are, IMHO, not frequent enough to warrant a new type (why not also TVSCRIPT, FILMSCRIPT, PROSEPOEM, HAIKU, VIGNETTE, etc...). On a more general theme, please remember that the multiplication of possible choices in our categories (let's not talk about format/binding) makes the task of explaining (and correcting) them more and more difficult for those of us that undertake the task of "speaking-to-new-contributors". I'm not sure that all of the participants of this discussion remember clearly how complicated the ISFDB is for a new entrant.Hauck 19:02, 3 March 2017 (UTC)
I do not think that a "play" type would be at all confusing, and even though it's true that there's only about a hundred examples so far, still they're obviously distinct. As a bonus having this title type would allow doing away with some disambiguators like "Dracula (stage play)".
As for the confusingness of fictive essays, I'm coming around to the idea that having them as a check-option for shortfiction would be best. It's less serious if people don't check boxes that should be checked than if they assign things to the wrong type. --Vasha 20:22, 3 March 2017 (UTC)

(unindent after an edit conflict) Let's take a step back and consider whether "facetious/fictive essay" would be best handled as a separate title type or as a flag similar to the currently existing "non-genre" flag.

Aside from the Title page, which is self-explanatory, I can think of two bibliographic pages which will display the data differently depending on our choice:

  • the Publication page, specifically its Contents section, and
  • the Summary page

If we make it a title type, the Contents section of a Publication page will say something like:

  • vii • Introduction (The Statement of Stella Maberly, Written by Herself) • fictive essay by F. Anstey [as by uncredited]

If we make it a flag, here is what the same line will look like:

  • vii • Introduction (The Statement of Stella Maberly, Written by Herself) • short fiction [fictive essay] by F. Anstey [as by uncredited]

As far as the Summary Bibliography page goes, the difference is that making it a separate title type will result in a new Summary section. On the other hand, if we make it a flag, then the affected titles will appear in the existing "Short Fiction" section with a "[fictive essay]" indicator added.

My current thinking is that a separate Summary page section for fictive essays may be excessive, so I would be inclined to go with a flag. We will then need to decide whether the title type of "fictive essays" should be ESSAY or SHORTFICTION. Ahasuerus 18:56, 3 March 2017 (UTC)

"fictive essay" sounds like "a little bit pregnant" to me. And if we go with that, would someone decide that this is a good flag for a 1950s science article that was essay back then (because it was considered true) but since then had become invalid (so not non-fiction)? Annie 19:06, 3 March 2017 (UTC)
As for whether this type is useful... Well, the Mad Scientist Journal is almost nothing but in-universe pieces. Every issue has an "editorial", "advice column", "horoscopes", and "classifieds" supposedly written by mad scientists. I really don't know what to call those -- they aren't short stories or novelettes. They have to be something else, whether it's a flag or a new type.
Annie's concern would be addressed if this was handled as a labelled subtype of SHORTFICTION. I don't think anyone would shift an essay from nonfiction to fiction just because it lauded Wilhelm Reich. --Vasha 20:02, 3 March 2017 (UTC)
We generally decide whether a work is fiction or non-fiction based on the stated intent. If a story about a kidnapping by aliens is presented as a true account, then it's non-fiction regardless of how accurate it is. In addition, as per our definition of speculative diction, SF includes "works set in a future that is now in the past [and] that deal with technological advances that were futuristic at the time they were published", so I think we are covered there. Ahasuerus 20:25, 3 March 2017 (UTC)
I am mostly thinking about someone not reading the rules and seeing a name in the list that sounds like something else - all of our types are self-explanatory on their own (except EDITOR - but that is a different story). I know that docs clarify it, but we have a lot of those. :) Annie 21:49, 3 March 2017 (UTC)

Submission viewer tweaked

The "submission viewer" page has been tweaked to display the name of the reviewing moderator, e.g. see this Fixer submission. Ahasuerus 16:49, 3 March 2017 (UTC)

Ethereal Tales, #7

Can anyone see any reason why these two: Publication 1 and Publication 2 need to stay separate? It does look as an oversight when the second one was added but if someone can confirm, I can go ahead and merge all of the matching elements (and find out which ones are not matching and why). Annie 17:02, 3 March 2017 (UTC)

Well, no! This really is a double entry. Stonecreek 18:44, 3 March 2017 (UTC)
I'll go clear them up then. And there is a serial hiding in there that the PV'd copy had not handled very well so I will also send them a note on the changes. Annie 19:09, 3 March 2017 (UTC)
I also noticed that the dates of the issue and contents are set to something other than the cover date -- I guess that ought to be checked for all VWCrist's submissions. --Vasha 23:44, 3 March 2017 (UTC)
I found it when one of the authors from it popped as "no language" and "has more than 3 works" (I am systematically exterminating these when they appear) and there was a duplicate in the 4 stories they had. Haven't got to looking at who had added it or why yet. And now you mentioning the name, I saw it somewhere else today as well... And I need to sort out what is a poem and what a story because there are a few inconsistencies - which will require a message to the PV :) Annie 23:58, 3 March 2017 (UTC)

Record numbers on award pages

Award, award category and award type pages have been modified to display ISFDB record numbers. The availability of the "[Edit]" links matches what is displayed in the navigation bar on the left: only moderators can edit award categories and award types. Ahasuerus 20:54, 3 March 2017 (UTC)

Advanced Search - "NOT" changes

Based on the recent discussion of Advanced Search, I have added "is not exactly" and "does not contain" to the drop-down list. We'll see whether it approximates the requested "AND NOT" functionality.

Based on my testing, searches complete reasonably quickly if the results are manageable. For example, an Advanced Title Search on "Author's Name contain heinlein" AND "Title Year does not contain 19" generates a list of 21st century titles by Heinlein. If, however, you were to change the "AND" to an "OR" in this search, it would take well over 30 seconds to retrieve the data. Of course, the results wouldn't be particularly useful anyway.

The good news is that lengthy searches don't seem to affect other users (much) because our server has had multiple processors since January 2016. Ahasuerus 22:03, 3 March 2017 (UTC)

That is awesome. Thanks for implementing it :) Annie 22:42, 3 March 2017 (UTC)
That's great! --Vasha 23:31, 3 March 2017 (UTC)
Thanks!--Rkihara 02:28, 5 March 2017 (UTC)

Length/title type mismatches

Edit Title has been modified to prevent users from entering "Length" values for anything other than SHORTFICTION. New/Edit/Add/ClonePub is currently in progress. Ahasuerus 20:07, 4 March 2017 (UTC)

Done. If you find a title type/length mismatch, please let me know. Ahasuerus 21:32, 4 March 2017 (UTC)

Enchanced CHAPBOOK and OMNIBUS validation

Edit Title has been enhanced to perform additional pop-up validation for CHAPBOOK and OMNIBUS titles. You will get an error message if you enter series or synopsis information for a CHAPBOOK title. You will also get an error message if you enter a Content value for a non-OMNIBUS title. Also, Content values can't start with a slash and have to be less than 32 characters long. Ahasuerus 01:22, 5 March 2017 (UTC)

"Add New Omnibus" has been enhanced to use the same pop-ups as Edit Title. Ahasuerus 17:24, 5 March 2017 (UTC)

Date mismatch warnings

Import/Export submissions now show a warning when you try to import a title whose date is later than the publication date. I hope to add a similar warning to New/Edit/Add/Clone submissions tomorrow. Ahasuerus 23:11, 5 March 2017 (UTC)

ClonePub done. Also, EditPub has been modified to display date warnings for COVERART titles. It's a messy area and I need to tread careful lest I break something. Ahasuerus 23:13, 6 March 2017 (UTC)
Regular title warnings added to EditPub. Reviews and interviews are still outstanding. Ahasuerus 00:05, 7 March 2017 (UTC)
EditPub is done. AddPubs still need to be reviewed. Ahasuerus 20:51, 7 March 2017 (UTC)
NewPubs and AddPubs are done. At this point all Import/Export/NewPub/EditPub/ClonePub/AddPub submissions should warn you if a Contents title has a later date than the publication date. If you see anything odd, please post your findings here. Ahasuerus 21:44, 7 March 2017 (UTC)

Magazines and e-books

Under the current way we record magazines, there is no way to add an e-book version of the same magazine because it will show up on the grid as a duplicate. As a result we have some magazines that just show the duplicates, some where there are two separate series (for what is essentially the same magazine - causing the records to drift from each other when they are not updated together) or just not to have the e-versions recorded. The last option is what we have for the big magazines - which is in contrast to the books records where we are recording down to printings.

I know that some of you don't even want to think of the e-books but they are a reality and are here to stay. So anyone with ideas how to solve that little conundrum we are having? I do not think that keeping them in separate series really make sense (the drifting of content is going to continue), so we need other options. Moving the grid on the title level will require untangling the year records we have now... maybe allowing some intelligence in the grid where an e-book is shown only if there is no printed record and the printed record have links to the e-copy?. Or even allowing a checkbox to "not show in the grid" which suppresses the second copy from clustering but allows it to be available for search (a link will still be needed though - because we won't have the title to make it visible). Annie 16:07, 6 March 2017 (UTC)

Ha, the ebook coterie rears its ugly head again ;-). In this case, I'd prefer to have a different title series for the ebook (as we do with Clarkesworld) this won't clutter the grids, will allow as much drift as possible and will kept the problems specific to each format (e.g. if a text is deleted from an ebook by the publisher as happened IIRC with amazon) separate. We may even use the sub-series concept to link the print and the electronic version to the same parent. Hauck 16:31, 6 March 2017 (UTC)
Well, Analog and Asimov's have the same content so we need a way to make sure that if we keep them separate, changes are applied in both copies. Amazon does not delete stories from the middle of an e-book they did not publish :)Annie 16:45, 6 March 2017 (UTC)
IMHO it's an heavy trend (I don't know if it's the correct english idiomatism, we speak of "tendance lourde") to see a divergence in time between print and electronic as publishers make use of all the possibilities of the latter in term of improved (enhanced) content (it's already happening in other domains, e.g. for this magazine that I follow that has more content in the numeric version). So I bet that we will have to keep ASF or Analog separate at some point in the future. Hauck 17:19, 6 March 2017 (UTC)
True. Although I doubt that the pure text magazines will go that way anytime soon. I guess we will end up having two separate series, technically with the same content (and with links set by whoever enters the e-version) to ensure that they are linked. Or something like that. My main concern is data integrity - mistakes happen and when content is imported get populated and they won't get fixed if the magazines are not connected. Annie 18:27, 6 March 2017 (UTC)
This exactly the situation where moving magazines to be pub series over title series would help (I am not suggesting getting rid of magazine editorial records and series but just that magazines not be defined by them as they currently are with seriesgrid: "Issue Grid", etc.). It would also separate out all the magazine publications on publishers pages (which currently get lumped into pubs_not_in_series: "Publications not in a Publication Series for Publisher"). Defining magazines as pub series would allow for separate magazine runs while sharing the same editorial credits (regardless of possible content changes between runs). Uzume 16:30, 12 March 2017 (UTC)
Let me make sure that I understand. It sounds like you are suggesting that we:
  • Keep the EDITOR titles and the currently existing EDITOR series
  • Continue using EDITOR series to organize magazine records on Summary pages
  • For each MAGAZINE/FANZINE publication, enter the name of its title series in the Publication Series field (the original data population effort can be automated)
  • If a MAGAZINE/FANZINE issue had multiple editions, e.g. there was a electronic version and a print version or there were 2+ different versions published in different countries, disambiguate the publication series name
  • Rewrite the Series Grid software to use the newly created Publication Series data instead of EDITOR records
Is this about right? Ahasuerus 17:20, 12 March 2017 (UTC)
That's wonderful, I love it! --Vasha 20:05, 12 March 2017 (UTC)
Assuming that I interpreted Uzume's proposal correctly, my first concern is about data duplication. Every time the same data is recorded in two different places, it inevitably begins to diverge. Ahasuerus 01:06, 13 March 2017 (UTC)

(unindent) Yes, exactly. If we do not employ some automated mass migration magic (as you suggest), we would need an interim solution until everything is converted over. This would then allow editorial records to be later merged (we do not really need multiple records for multiple print runs unless there is some change to the editorial between runs which in most cases does not occur). For instance, once Clarkesworld (print issues) and Clarkesworld Magazine are converted to pub series, Clarkesworld (print issues) and Clarkesworld Magazine could be merged. Neil Clarke (and others earlier on) would still get appropriate editorial credits but the magazine runs would show up on Clarkesworld Magazine and Wyrm Publishing since they are now a pub series entity. There are some caveats however. For example, currently we allow titles series to link to other title series but this is not true of pub series. It would be complicated to create an automated mass migration of things currently organized like Vargo Statten British Science/Space Fiction Magazine (which is an series/issue grid of a title series with no EDITOR records but other title series with EDITOR records). Other differences to note are that pub series have transliterated names available and titles series to not (probably not an issue for this migration concept). Also currently seriesgrid: "Issue Grid" can be applied to other title series like Gor without much value, however, a pub series based series/issue grid could be usefully applied to pub series like OPTA - Aventures fantastiques. Pub series contain pubs and title series contain titles and as such this conversion would allow each pub in the pub series to also have a "Pub Series #" that could correspond to its issue number (I am not sure of a good way to automate such in a mass migration strategy). We would likely also want to change several other things like magazine searches and directories to find the pub series and not the editorial series, etc. The point is we sort of want it to diverge as they represent different things (the editorial of a magazine is related to but not the same as the magazine and its run itself). Uzume 01:14, 13 March 2017 (UTC)

As for french (and generally european publications series) I don't see the added value of putting them in a grid (vs our present system that allow a view either by chronogical or "numerical" order). Such a publication series (which is not that "special") would give a quite crowded (and IMHO unreadble grid) with #373 appearing at 15 points on the grid. The same can also be said of this american one. Note also that, because of our present knowledge and some publisher's practices, the "no-month" cell of the grid my be a bit overcrowded. Hauck 07:38, 13 March 2017 (UTC)

Updating Policy re: dates of birth

With identity theft becoming more of a concern and data deletion requests becoming more frequent, we need to update ISFDB:Policy re: living authors' dates of birth. Here is the latest major discussion of data deletion requests and other issues related to dates of birth. For simplicity's sake, I suggest that we use the same standard that Wikipedia uses:

If the subject complains about the inclusion of the date of birth, or the person is borderline notable, err on the side of caution and simply list the year.

We can eliminate "the person is borderline notable" part since we don't use notability as an inclusion criterion, but otherwise it seems to be a good fit. Also, since Wikipedia and the ISFDB server are currently subject to the same national laws, it's likely that we'll find out about any legal challenge to Wikipedia's policy before we face a similar challenge.

Based on these considerations and the linked Rules and Standards discussion, I plan to update the Policy page as follows:

If a person complains about the inclusion of the person's date of birth and provides evidence that he or she is the listed person, the ISFDB will replace the date of birth with the year of birth.

I am not very happy with the "evidence" part of the proposed language, but I see no other way to prevent vandalism and frivolous requests. Ahasuerus 16:09, 6 March 2017 (UTC)

OK for me for an american site, if we were based in France the total deletion of personal data on request is in the law. Hauck 16:23, 6 March 2017 (UTC)
Yes, "the right to be forgotten", which exists, in various forms, in a number of countries. If we ever move the server to another jurisdiction, it will be one of the things that we will need to consider carefully. Ahasuerus 16:54, 6 March 2017 (UTC)
That's why what was done without discussion and without my consent on the Moderator Availability's list (adding our complete names) is here considered very bad manners and may be downright illegal. Hauck 16:23, 6 March 2017 (UTC)
I was surprised to see the changes even though I think that they were well-meaning. Moderators generally add their own names to the Moderator Availability template and it's up to them to decide how to list their names. Ahasuerus 16:58, 6 March 2017 (UTC)
Are you talking about my recent changes to Template:Moderator-availability (as per 466661)? You will note, though I rearranged the names (making them more noticeable), I did not add any (most were in the original creation by Nihonjoe on 2015-06-04 as per 392440; some were added later with later moderator changes/adds). Uzume 00:21, 13 March 2017 (UTC)
I was referring to the addition of first names and last names, e.g. "Chris J" became "Chris Jensen" and "Dwarzel" became "Desmond Warzel". Of course, their names can be easily found on other Wiki pages or in the database itself, but it's generally up to each moderator to decide how they want their user name listed. Ahasuerus 01:02, 13 March 2017 (UTC)
I noticed Mhhutchins and Hauck recently pulled their names out but I did not add those, however, it seems you are right, a few did somehow sneak in on that edit (I did not think I pulled those in but as you say they are directly linked from their user pages which are linked in the template). My apologies. Uzume 01:45, 13 March 2017 (UTC)
I'm fine with codifying a mechanism for the removal of DOBs, but I agree the evidence part will be tricky; we will probably also need to have some guidelines as to what we will consider acceptable as evidence. Albinoflea 16:27, 6 March 2017 (UTC)
A couple of years ago an author registered as an editor and asked to have her DOB reduced to YOB. I said I would do that if she could prove who she was and that I would send an email to her website for confirmation of identity. No response, but she made the edit as an editor. I decided to let it go through.--Rkihara 18:49, 6 March 2017 (UTC)
In the case I have at hand, it's the YEAR that's private, and the month and day are publicly available, so the proposed wording wouldn't cover the desired/"needed" change.
I guess I'm more inclined to France's approach as a default: We should agree to remove any private or quasi-private identifying information upon the individual's request. A possible private-vs-public bar could be "can[not] be found via Google search". Since we have no way to prevent anyone from adding it again, and we have no way to record that the information is less-than-full information is recorded at the author's request, we would have to be clear that there's no guarantee of its staying that way (and anything public/published is almost certain to come back, which would be justification for not wasting time removing it, beyond the fact that removing it isn't doing anything to enhance information security). --MartyD 19:30, 6 March 2017 (UTC)
Keep in mind that once we finish migrating Wiki-based publisher and series/magazine pages to the database, we will add a "Note" field to author records. Once it's available, we will be able to add notes like "Date of birth removed as per author's request", which should help prevent DOBs from reappearing. (The {{BREAK}} syntax will come in handy.)
As far as this particular case goes -- the year is private while the month and day are public -- I suspect that accommodating it would quickly lead to, as you wrote, having to remove any biographical information upon request. We'll have to revisit this issue when we move our "Bibliographic" and "Bio" pages to the database, but for now I am not ready to go that far. Ahasuerus 20:02, 6 March 2017 (UTC)
P.S. As far as defining "publicly available sources" goes, it's an interesting line. Wikipedia's policy says:
  • Do not use trial transcripts and other court records, or other public documents, to support assertions about a living person. Do not use public records that include personal details, such as date of birth, home value, traffic citations, vehicle registrations, and home or business addresses.
Which, as far as I can tell, would pretty much limit us to Google and other search engines if we were to follow it. And that's not necessarily a bad thing, although there is a possible wrinkle: some search engines serve different results depending on the user's location. Ahasuerus 20:12, 6 March 2017 (UTC)
Would it be possible to add a switch (basically, a checkbox next to the field when in the editing screen) that turns off the display for that information until a date of death is entered? It could be there for date of birth, location of birth, and legal name, since those are likely the fields someone might be concerned about. That way, the information could still be in the database, but it wouldn't appear to the public unless they were no longer living. ···日本穣 · 投稿 · Talk to Nihonjoe 20:35, 6 March 2017 (UTC)
Is it really worth the effort if the information is easily and freely available on the internet? Maybe we could avoid the issue by posting the links, or citing the references giving POB, DOB, etc., instead of listing it explicitly for living authors? Then the authors can petition the root sources.--Rkihara 21:58, 6 March 2017 (UTC)
I am all for citing our sources once we have the Author Note field. Take the submission that prompted this discussion. The author in question stated that her full DOB and place of birth are not publicly available and sure enough, googling doesn't seem to find anything. So where did our data come from? It may have been a print source like Contemporary Authors or it may have come from some database that us not indexed by Google. It's hard to tell without a cited source.
As far as leaving the field blank and linking to the source goes, I suspect that it would make our data much harder to work with. URLs change all the time even when the underlying data remains the same. Ahasuerus 23:20, 6 March 2017 (UTC)
If it's the submission that MartyD has on hold, I posted the DOB and POB (I keep a short record of authors that I enter DOB and DOD for). The source was Contemporary Authors Online, which lists education, hobbies, and career hightlights.--Rkihara 00:11, 7 March 2017 (UTC)
That's a good example. Contemporary Authors Online is an established biobibliographical source which is used by Wikipedia (see this example) and other sites, but, as far as I know, it's not available without a subscription. I believe its data is made available to educational institutions and subscribers. On the other hand, they offer a free trial, so if someone is interested in a particular author's biographical data, all they have to do is set up a free trial account and look things up. So... Can we say that its data is publicly available? Ahasuerus 02:06, 7 March 2017 (UTC)
I would say that CA is so widely cited and available that it can be said to be public knowledge. It is by subscription, but I have access through several channels, including my local library, which also carries the hardcover edition, and other biographical sources.--Rkihara 04:31, 7 March 2017 (UTC)
Thanks for clarifying, I am sold on the notion that the CA data is "publicly available". Ahasuerus 16:02, 7 March 2017 (UTC)
We could build in the ability to archive online sources (using Web Citation or another archive service). I use this all the time when writing articles on Wikipedia to avoid link rot. ···日本穣 · 投稿 · Talk to Nihonjoe 23:58, 6 March 2017 (UTC)
Looks interesting. Do they let Web site owners delete copies of certain pages the way the Internet Archive does? Ahasuerus 16:42, 7 March 2017 (UTC)
They have this policy. ···日本穣 · 投稿 · Talk to Nihonjoe 19:51, 8 March 2017 (UTC)
I see. It sounds like they too have to worry about dealing with various cans of worms. Ahasuerus 22:18, 8 March 2017 (UTC)

(after sleeping on it) I guess we have a few separate issues here.

The first one is how we want to define the "publicly available sources" which we are permitted to use. I think it would be prudent to explicitly exclude government (courts, taxes, immigration, vehicle registration, etc.) records for living persons. We can let other projects take care of the headaches that they cause. For example, just recently the SFE3 editors spent a fair amount of time exchanging e-mails, including scans of immigration records, with a certain SF writer who had disputed the year of birth listed by SFE3. We bowed out of that dispute by saying that we'd quote whatever SFE3 settled on.

The second issue has to do with documenting our sources of biographical data as well as author requests for data deletion. The plan has always to add a Note field to Author records and then to migrate Wiki-based Bio and Bibliographic pages to the Note field. (We still need to decide whether we want to have a separate "Bio" field as well.) However, the original plan was to wait for the publisher/series/magazine Wiki cleanup project to be completed before adding a Note field. Given the fact that we still have 500+ Wiki pages to migrate and the need to support the ability to document the sources of biographical data, I think we should implement the Author Note field sooner rather than later.

The third issue has to do with accommodating author requests to remove otherwise eligible data. Earlier we seemed to agree that we needed to ensure that the requester was the person whose data s/he was asking to remove. However, I think we also want to allow authorized representatives (Web masters, spouses, etc) to make these types of requests. For example, the person in the previously mentioned SFE3 controversy communicated via his Web master.

The fourth issue is what types of biographical information we should be willing to remove upon request. At this point we have seen requests to delete:

  • the year, month and date of birth
  • the month and date of birth, but not the year of birth
  • the year of birth, but not the month and the date of birth
  • the exact place of birth, but not the country of birth

Should we use the Wikipedia standard ("If the subject complains ... list the year") or should we be more accommodating? What about requests to remove legal names? Ahasuerus 18:09, 7 March 2017 (UTC)

I think that issue #4 could be handled by removing the entire date and giving the online reference which contained the information. The author can hardly object to that, and it redirects the author’s attention to where it belongs - as we're just the messengers.
I would also suggest adding the following statement in bold at the bottom of biographical info, “Some personal information has been redacted at the request of the author or the author’s representatives.” This will also warn off editors who might re-enter the redacted data.--Rkihara 18:30, 7 March 2017 (UTC)
Well, we already support the {{BREAK}} template in Note fields. Once we have the previously mentioned Note field, we could add support for a {{REDACTED_PERSONAL_INFO}} template, which would display the message that you proposed. Ahasuerus 19:01, 7 March 2017 (UTC)
The author may WANT their date of birth to be private, but as we all know with varying degrees of chagrin, once something is on the internet, trying to get rid of it is like trying to mop up a flood with a kleenex. Nonetheless, there's a difference between having the information "out there" and having it on a semi-authoritative site that might be thought of as a reference source -- like Wikipedia, SFE3, or the ISFDB. I can see someone not wanting their info on the latter even when they can't do anything about the former; their info wouldn't be formally public. How sympathetic do we want to be to that? --Vasha 19:31, 7 March 2017 (UTC)
Admittedly it's a fine line. For example, suppose we were to adopt Ron Kihara's proposal immediately above: "issue #4 could be handled by removing the entire date and giving the online reference which contained the information". In the case that prompted this discussion, we would then remove the author's year of birth and add the following note: "Year of birth available in Contemporary Authors. Redacted as per author's request." If someone wanted to steal the author's identity at a later point and googled "[author name] year of birth", Google would helpfully serve our Summary page. The bad guy could then drive to a local library and look things up. Is that something we have to worry about? Where do we draw the line? Ahasuerus 22:26, 8 March 2017 (UTC)
Well, we don't have to specify what was redacted, and it will take more effort to find. If I can find the data (and I spend only a few minutes per), then someone who really wants to find this data wll find it too. I also think if an author wants the year of a birthdate redacted, we should redact it all. It really irritates me to see, e.g., born October, or born October dd, with no birth year. The same with place, but not country of birth.--Rkihara 23:21, 8 March 2017 (UTC)

Omnibus or collection

As I am always getting confused - if we have a book containing 1 novel and 3 stories, is that an omnibus (as it contains a novel) or collection (because the 3 stories are not published independently)? In my mind, a novel in the content makes in an omnibus but our conventions are a bit confusing. Annie 22:30, 7 March 2017 (UTC)

Probably collection. See the OMNIBUS bullet of Help:Screen:NewPub#Publication_Type and its specific Heinlein example. This may be pure Male Answer Syndrome, but I believe the intention behind OMNIBUS is that it collects multiple works previously published standalone (so short stories that appeared only as part of some published collection or in a magazine don't qualify). --MartyD 01:43, 8 March 2017 (UTC)
These days any story can be published on its own - making this a collection of two published works (which we call an omnibus as one of them is a novel). If we want to say that we need at least 2 novels/collections/anthologies/non-fiction (we say at least 1 now) to declare it an omnibus - I am fine with that and I think that was the intent behind this definition. But this is why I asked. Annie 02:57, 8 March 2017 (UTC)

Author Note and Author Bio: one field or two fields?

As per FR 307 and the earlier discussion of biographical data, we plan to migrate all of our "Bio" and "Author" pages from the Wiki to the database proper. Changing the software to support a new field is not hard, I can do it in a few hours. However, first we need to decide whether we want to add:

  • one new field, basically a generic "Note" field similar to all the other Note fields in the database, or
  • two fields: one for general purpose bibliographic notes and another for biographical data, which would match the current Wiki layout

It stands to reason that all Wiki-based "Author" pages will be migrated to the new "Note" field. The real challenge is deciding whether the contents of Wiki-based "Bio" pages can be accommodated by the "Note" field as well. Based on a cursory review of the "Bio" pages, we'll be dealing with the following scenarios:

  • Information about the source of our author data, e.g. "Middle name from Locus". Sometimes it can get complicated, e.g. Bio:A. V. Clarke, and require the use of the {{BREAK}} template. This data will always go into the Note field even if we decide to have a separate Bio field.
  • Additional information about pseudonyms like "A Ziff-Davis house name". Will be migrated to the Note field.
  • Basic biographical information, e.g. "Born Andrei Perlmutter" or "Poul Anderson's son-in-law" or "Vernor Vinge's wife in 1972–1979". Can be easily accommodated by the Note field.
  • More detailed biographical articles like Bio:Irene Maude Swatridge. They can be accommodated by the Note field, but they may require the use of the {{BREAK}} template.
  • Really detailed bio pages, usually added by the author, e.g. Bio:Charles G. Waugh. They are the exception rather than the rule, but they do exist. The {{BREAK}} template will effectively move them to a separate Web page, so I think we can put them in the Note field without causing a problem, but I can see how having a separate field may be useful in certain cases.

Given the above, I am 95% sure that we can get away with having just one Note field. Does this sound reasonable? Ahasuerus 00:09, 8 March 2017 (UTC)

I do not think that there is a clear line between bibliographic and biographic note in the case of authors -- does a note on pseudonyms belong to the bibliographic part or is it part of the biography for example? I vote for one note field only. Annie 00:27, 8 March 2017 (UTC)
I agree one Note field seems adequate. --MartyD 01:45, 8 March 2017 (UTC)
To be frank, I've always found that the "biographical" part falls largely outside our scope. IMHO we're a bibliographical tool and not a place for self-promotion or egoboost and so only the basics should be listed (the existing fields are sufficient for me). As a frequent moderator-of-new-contributors, the "biographical" pages are where there is the more "pruning" to do. Hauck 07:25, 8 March 2017 (UTC)
I agree that author-provided biographies can get out of hand, but first a little bit of background. Back in the 1990s, during the "ISFDB 1.0" era, i.e. pre-moderation, there was an "Author Note" field. It had all kinds of data, much of it not very good. It was a learning experience.
When we started work on ISFDB 2.0, the plan was to rely on Wikipedia to house biographical data. However, we quickly discovered that Wikipedia's "notability" criteria were too restrictive for our purposes: we have tens of thousands of authors who do not have (and never will have) a Wikipedia article. That's when the idea to use our Wiki to store author bios for less notable authors was born. Eventually it led to other issues, which is why the Wiki migration project was started a couple of years ago. Ahasuerus 15:32, 8 March 2017 (UTC)
P.S. The original 589 "author notes" from the 1990s and the early 2000s are still stored in the database although you can't access them. Many of them can be safely dropped, e.g. the following note about L. E. Modesitt, Jr.: "Author of over 20 fantasy and SF books, including the best selling Magic of Recluce series". However, there are a number of more useful ones, e.g. "Son of Fritz Leiber", "Married to SF author Charles Sheffield (1998-2002)", etc. Once the new field becomes available, I will create a cleanup report which will facilitate migrating the relevant ones. Ahasuerus 16:11, 8 March 2017 (UTC)
That is not very different from the other wiki pages cleanup - there is a lot of outdated information in them as well (and a lot of irrelevant one that is superseded by adding books and similar actions. Annie 16:14, 8 March 2017 (UTC)
True, although some older "author notes" are really strange. For example, here is the internal note for Edgar Pangborn: "None yet.<br><b>Sources:</b> TEoSF.". Make of it what you will :-)
Another difference is that we will be migrating three different types of author notes:
  • 589 database-resident notes mentioned above
  • a couple thousand Wiki-resident pages in the "Author" and "Author talk" namespaces
  • a couple thousand Wiki-resident pages in the "Bio" and "Bio talk" namespaces
Ahasuerus 16:29, 8 March 2017 (UTC)
That sounds like a fun project. I've seen stranger in some of the pages I cleaned - some of the 2008 notes were... interesting. :) Annie 16:39, 8 March 2017 (UTC)

(unindent) OK, "Author Note" is now available. Here is what A. V. Clarke's Summary page looks like now. It demonstrates the {{BREAK}} functionality, which can be used in a variety of ways. Ahasuerus 22:04, 8 March 2017 (UTC)

The changes make some pages look pretty stark, for example Bill Thompson's page. It would look better if the author name was in a larger font and bold, and "author:" removed, since it's redundant.--Rkihara 23:26, 8 March 2017 (UTC)
Is the starkness caused by the removal of the "Biography" and "Bibliographic Comments" lines for authors who do not have Wiki-based comments? As far as the author name goes, we currently display it twice: once in the header after the words "Summary Bibliography" and then again on the "Author:" line. It's done the same way on all bibliographic pages, including Title, Publication, Publisher, and Series pages. Ahasuerus 23:46, 8 March 2017 (UTC)
That's basically it. If no language is defined, there's just the author name in small font on one line. Maybe replacing the author line with the header, "Summary Bibliography: John Doe" in the large font would help the appearance? I think it's the white background drawing my attention away from the header on the black background.--Rkihara 00:48, 9 March 2017 (UTC)
Keep in mind that the Bio/Biblio links will be removed from all the other pages Real Soon Now (tm), so this issue will affect more than just the Summary page. For example, consider this series. Once the "Bibliographic Comments" line disappears, the header will consist of just one line. Ditto this publisher etc.
I am going to go ahead and remove these links from all series/magazine/publisher pages that do not have associated Wiki data. Once I do that, we will have a better idea of what the pages look like and will better position to decide how to change their layout. Ahasuerus 01:04, 9 March 2017 (UTC)
Done. I am going to create another section to discuss the layout implications. Ahasuerus 01:42, 9 March 2017 (UTC)
Done. Ahasuerus 01:54, 9 March 2017 (UTC)
And when are we getting a report? :) Annie 22:16, 8 March 2017 (UTC)
Real Soon (tm) :-) Ahasuerus 23:46, 8 March 2017 (UTC)

New cleanup report: "Author Notes to be Migrated from ISFDB 1.0"

"Author Notes to be Migrated from ISFDB 1.0" is now available in the main Cleanup Reports menu.

Please note that the data in the "Old Note" column comes from ISFDB 1.0 (1995-2004) and is not accessible in any other way. The data in the "New Note" column comes from the newly added "Author Note" field.

The report is unusual in a couple of ways:

  • The data is not generated nightly. Every time you access this report, you get a fresh copy.
  • There is no way to "ignore" author records or to remove them from the report. Once the useful tidbits (and there are some) have been migrated from the "Old Note" column to the "New Note" column, the old notes will be deleted from the database and this report will be deactivated.

Ahasuerus 00:58, 9 March 2017 (UTC)

Changes to database-Wiki links

The way Wiki links are displayed on the database side has been changed as part of the Wiki migration project. In the past the links were displayed regardless of whether a matching Wiki page existed. As of 15 minutes ago, the links are only displayed if a matching Wiki page exists. (Once the Wiki migration project has been completed, direct links to existing Wiki pages will be removed and we will use "Web pages" fields to link to the Wiki exclusively.)

Now that 99% of all links are gone, we need to decide whether the resulting layout looks good. For example, here is what the Summary page for an author without a language looks like. Here is an author with a language and no other data. Here is a publisher with a single publication. Do the pages look too sparse/stark? Ahasuerus 01:53, 9 March 2017 (UTC)

I like the wiki links being hidden, but I don't like hiding the empty database fields. I think that could discourages editing for a newer user who may have information, but isn't even aware that the fields are available. It also makes the page look pretty sparse. -- JLaTondre (talk) 02:16, 9 March 2017 (UTC)
Contra JLaTondre, I think it would look terrible to have a list of fields reading "unknown" on every page; and I don't think that it would encourage that much extra editing.
However, the name of the author/publisher/whatever should definitely be larger or highlighted so it stands out from the other elements of the page. --Vasha 02:21, 9 March 2017 (UTC)
I agree with JLaTondre's remarks. I don't like this "new" look (that's personal, of course) and it doesn't give a hint of all what's possible for our contributors. As I understand it, the "ISFDB-wiki" links will be among the web links listed, so the understanding that these specific links are "ours" and so are editable may be a bit complicated for the average user. Hauck 07:16, 9 March 2017 (UTC)
Most of the existing wiki-pages will be converted to the DB field - the only ones that will remain as wiki pages will be the ones that are too long or complicated to move (and I suspect even some of them will get moved sooner or later). Annie 07:32, 9 March 2017 (UTC)
Let me make sure that we are all on the same page. Bibliographic (Summary, Series, Publication, etc) pages display two different types of data. There are "database fields" and "Wiki links". What JLaTondre is proposing is that we display empty database fields. Here is what the previously linked Summary page would look like if we were to display the empty fields:
Author: Kathleen Notestine
Transliterated Name: 
Legal Name: 
Transliterated Legal Name: 
Email Address:
It would be easy to implement, but I don't think it would look better than what we have now. Ahasuerus 14:24, 9 March 2017 (UTC)
As I mentioned previously, the missing fields make it look too stark, somehow deprecated. I can't put into words exactly what it is that bothers me about it. Removing "author:," centering the name at the top of the field in a larger, bold font size, and removing the header "Summary Bibliography:" would do a lot to improve the appearance, IMHO.--Rkihara 16:33, 9 March 2017 (UTC)
One thing that comes to mind is that we use HTML bullet ("unordered") lists to offset "Author", "Language", etc fields. A bullet list consisting of one bullet looks odd. In addition, the offset makes these fields align with the contents areas of other sections like "Short Fiction" or "Poems", which also isn't quite right.
There are a couple of things that we could do about this. First, we could move the "Author Record #" field, which is currently right-justified, to the main bullet list immediately under the Author Name field. That way the list will always have at least 2 bullets. Second, we could move the list to the left so that it would be aligned with section names rather than with section contents. Ahasuerus 17:01, 9 March 2017 (UTC)
That would help. After thinking about it a bit, I think that without missing field headings, what remains doesn't give you anything to focus on. The white background draws my eye in, then it jumps to the line below Showing all translations (can be changed in My Preferences) because it is bold and colored blue at the end. Then my eye wanders around to the author: line above, but it keeps getting distracted by the line below. It's like an outline with plain headers and subs in bold. That's why I think the author should be centered in bold, large font. I have a friend who is a graphics designer and deals with this kind of problem in his work. I'll ask him for his opinion.--Rkihara 17:24, 9 March 2017 (UTC)
Why not change "Author:" to "Canonical Name:" like in the edit form (we already have the author name above in the "Summary Bibliography:" and put the list of works, etc. in a different "Works" (or similarly named) box much like the "Contents" box of publications (which have the publication data in one box and the "Contents", etc. in a separate box below it). It seems to me, this type of delineation would also be useful in other places like title displays (where title data could be in a separate box from the list of publications of such title, etc.). This would help underscore which data belongs to the author record and which were just associated with it. Uzume 19:06, 12 March 2017 (UTC)
I am afraid I don't understand what you are proposing. Ahasuerus 21:21, 12 March 2017 (UTC)
I am proposing to put the list of credited titles on author pages into a separate box clearly delineating which is author data and which is author associated data. For example P348699 currently displays the publication data in a box and the associated contents in a separate "Contents" box below it. Do the same thing with author's works in a "Works" box on author pages (and relabel "Author:" as "Canonical Name:" as it is labelled in the author edit form). I am not suggesting (re)adding empty fields to the display (though that could be done as well). To get technical, right now all author data and associated author data on author pages are in <div id="main">. Publication data are in <div id="content"> and associated publication data are in <div id="ContentBox"> (and <div id="VerificationBox">, etc.). With proper styling, this will clearly separate what can be edited in the author record and what cannot directly be edited there. Uzume 21:50, 12 March 2017 (UTC)
Oh, I see. Thanks for the explanation! Come to think of it, we already have a line ("<hr>") which is supposed to separate author-specific data from the author's titles, e.g. see Poul Anderson's Summary page. However, it is only displayed if we have an author image on file. Let me see if I can make it appear for all authors... Ahasuerus 22:19, 12 March 2017 (UTC)

(unindent) The software has been modified to display a thin gray line between the author-specific data and the list of author's titles on all pages. In the past the line was only displayed if the author had an image on file. Ahasuerus 22:33, 12 March 2017 (UTC)

Yes, something like that (though I still like the separate box delineation better; I notice a similar hr rule is used for non-genre). That does make Kathleen Notestine and A. Testa (the sample authors mentioned in this thread) look a little better. I would still recommend changing the label "Author:" to "Canonical Name:" to match the edit form. Also a similar delineation would be good for publishers (as mention above for Barzakh) and as I mentioned for titles too. Uzume 23:36, 12 March 2017 (UTC)
Well, "Canonical Name" is, as Help states, is "the name under which a particular author's bibliography is organized". For pseudonyms, the displayed name is not the same as the author's canonical name. I agree that synchronizing the field label on the Summary page with the field name on the "Author Editor" page would be good, but I am thinking that we may want to change the latter rather than the former. Ahasuerus 00:12, 13 March 2017 (UTC)
I agree that makes that wording confusing. Perhaps "Author Name:" is better and the Help could be updated to define "Author Name" as "the name under which a title/work is credited" and "Canonical Author Name" could remain as "the name under which a particular author's bibliography is organized" (even though we do not have anything where that is used except perhaps in pseudonyms and variants where we could distinguish "Credited Author Name" and "Canonical Author Name"). Uzume 01:36, 13 March 2017 (UTC)

The Illusion Seekers

Something does look weird here. The Illusion Seekers. Why is this story credited to unknown and then varianted for the proper author? If the reason is because P. F. Costello is a pseudonym then shouldn't instead it go to whoever is pseudonymed for? As it is - it is extremely hard to get a listing for "P. F. Costello" (the show all titles format is awkward and unwieldy for things like that) and this specific story only shows on the unknown list - which is unmanageable.

Is this by design? If so, why? Annie 18:45, 9 March 2017 (UTC)

One more like that The Monarch of Mars - seems to be my day to stumble on them. Some background will really help. Annie 18:53, 9 March 2017 (UTC)
"P. F. Costello" and "John Pollard" were house names owned by Ziff-Davis. Z-D used a lot of house names, most famously "Alexander Blade". Sometimes we know the actual author, other times we don't. We start by creating a title record with the house name listed as the author. Then we variant it to the actual author (if known) or to "unknown" (if unknown.) If and when we discover the actual author, we update the canonical title.
So yes, it's done by design. However, I agree that the format used by "view all titles by this pseudonym" is not perfect. Suggestions welcome! Ahasuerus 19:19, 9 March 2017 (UTC)
Someone coming in the site for the first time will be very very confused. Knowing that these are Z-D house names, can't we have a new author for all Z-D house names and not alias under unknown - which looks just weird... At least this way you can see that it went there because it is a House name. Annie 19:25, 9 March 2017 (UTC)
Well, it's a thought, but let's consider the implications. What about Daisy Meadows, a 21st century house name with hundreds of books to "her" name?
I guess one way to approach this issue would be to create a new author record for "undisclosed house name" and variant all undisclosed titles by "Alexander Blade", "Daisy Meadows", etc to it. Ahasuerus 22:02, 9 March 2017 (UTC)
But Daisy Meadows is not pseudonymed under unknown. I do not have issues with her display - all she needs is an author note (already there - just need moving) and all is set. It is the ones that ended up into unknown (because some books are really unclear) that are the problem. And yes - having a "undisclosed house name" will be preferable to the current "unknown". Annie 22:16, 9 March 2017 (UTC)
Keep in mind that pseudonyms and VTs are handled separately. There are many Daisy Meadows titles whose author we do not know -- e.g. this one -- and whose canonical author is currently "unknown". In this respect "her" bibliography is similar to what has been done with the Ziff-Davis pseudonyms. The difference is that there is no pseudonymous relationship between "Daisy Meadows" and "unknown".
We could certainly remove the "unknown" pseudonym from the Ziff-Davis pseudonyms to match what has been done with Daisy Meadows, but it could have unfortunate side effects. For example, consider John Dexter, a house name used by Greenleaf Publications in the 1960s. At the moment "his" Summary page reads "Pseudonym. See: Marion Zimmer Bradley", which makes it appear like it was an MZB pseudonym. A few weeks ago I received an e-mail from an MIT librarian who wanted to add another "John Dexter" title to the ISFDB and to his catalog. It was our data that had suggested to him that the book was written by MZB.
Thankfully, Robert Silverberg was another SF author who wrote as "John Dexter". Once we add his Dexter titles and link everything, it will become clear that "John Dexter" was a house name. However, we are not so lucky in the case of "John Pollard". If we were to remove "unknown" from the list of pseudonyms, it would look like it was a personal pseudonym used by Howard Browne. I guess it will be less of a concern now that we have the Author Note field. Ahasuerus 22:50, 9 March 2017 (UTC)
I understand how we ended up here. It is just a bit weird the first time you see one of those. Thanks for all the background! Annie 23:01, 9 March 2017 (UTC)
We could perhaps implement a new feature where an author is linked to a publisher instead of another author (as is done for pseudonyms; I always thought the design of keeping author and publisher as separate "authorities" was a dangerous one but it was made a long time ago). Then such house names could be unlinked from "unknown" (but known titles could still linked to the proper authors where available) and they could be shown on publisher pages and vice versa. Uzume 19:17, 12 March 2017 (UTC)
I am afraid I don't understand what it means to have an author "linked to a publisher instead of another author". Ahasuerus 21:17, 12 March 2017 (UTC)
Basically a pseudonym of publisher index/pointer (vs. of another author) field (or add a type field so you know which table to index into and reuse the existing index field). Uzume 21:34, 12 March 2017 (UTC)
Before we discuss the implementation details, I would like to understand what it means to have an author "linked to a publisher" functionally. Ahasuerus 21:46, 12 March 2017 (UTC)
It means it is a pseudonym associated with a publisher as house names commonly are. Is there something I am missing (I thought that was what we were talking about in this thread)? Uzume 23:26, 12 March 2017 (UTC)
Authors and publishers are so different that I am having trouble grasping how they could be linked. It's not like an author, a pseudonym or even a house name has to be limited to one publisher. For example, Alexander Blade was a Ziff-Davis pseudonym, but later on "Alexander Blade" stories appeared elsewhere, e.g. in Palmer Publications, Inc. magazines owned and edited by Ray Palmer and in Greenleaf Publishing Company magazines owned and edited by William L. Hamling. Once the stories fell into public domain, they were reprinted by project Gutenberg and a variety of PD publishers.
Then it gets worse. Much worse. To quote SFE3:
  • The use of house names was at its most extreme and most devious at the Ziff-Davis magazines edited by Raymond A Palmer. They have never been satisfactorily unravelled and all records are now believed lost. In these cases most pseudonyms which became house names were originally used by an individual writer but then became farmed out to others, adding to the confusion. Alexander Blade, for example, the most common house name, was originally used by David Vern (see David V Reed) but soon appeared on work by almost all the regular Ziff-Davis contributors, including the serial "The Eye of the World" (June-July 1949 Fantastic Adventures) written by Don Wilcox. Both P F Costello and Gerald Vance were originally the personal pseudonyms of William P McGivern but were later used by Chester H Geier, Rog Phillips and others. E K Jarvis was the alias of Robert Moore Williams until used by others in the 1950s. S M Tenneshaw was the alias of William L Hamling, and he took it with him when he began Imagination, but it has been used by several other writers. Ivar Jorgensen, sometimes misspelled Jorgenson, was originally the pen name of Paul W Fairman, but in later years it was used by Howard Browne, Harlan Ellison, Henry Slesar and Robert Silverberg, the latter usually in collaboration with Randall Garrett. Silverberg once quipped that he started out enjoying the work of Ivar Jorgensen and grew up to be him. Most of the work under these and other Ziff-Davis house names has yet to be accurately attributed. It is believed that Leroy Yerxa wrote almost the entire December 1943 issue of Fantastic Adventures with stories under house names except for one, Morris J Steele, which was usually the pen name of Raymond A Palmer himself but was here used by Berkeley Livingston.
Ahasuerus 00:54, 13 March 2017 (UTC)

8 cleanup reports for authors

8 author-specific cleanup reports have been added for "Bio" and "Author" pages. The rules for their migration are the same as for all the other cleanup reports. The data will become available tomorrow morning. As of last Saturday, we had 1,698 "Author" pages, 2,147 "Bio" pages, 30 Talk pages, and 156 orphan pages. Ahasuerus 21:59, 9 March 2017 (UTC)

Never had so much fun with clean-up rapports!...Dirk P Broer 21:47, 10 March 2017 (UTC)
For anyone that works these for the first time, don't forget after you move the data to add one of the Deletion templates to the wiki page so that the moderators can remove it. The templates are here Annie 21:50, 10 March 2017 (UTC)
Thanks for the info!--Dirk P Broer 22:44, 10 March 2017 (UTC)
For Fanzines and Magazines, We do not delete the wiki pages until at least stub pages are created for ALL issues references in the wiki (especially when all issues are eligible as it is with the fanzines). So I had to reverse your request for a delete on the fanzine. If you feel like creating the stubs - go ahead. But otherwise we lose the information for existing issues that someone collected. Annie 22:54, 10 March 2017 (UTC)
I created a similar category mechanism for marking wiki spam (see Category:Spam) back in March 9, 2011 and I had it linked to the top of the Moderator noticeboard (I am not sure when it was removed; sadly the wiki history gets purged so though I can look at the history of edits I cannot tell what was actually edited when—just the edit comments survive). This mechanism might be partially superseded, however by the newer deletion mechanism more recently created on October 30, 2016 (see ISFDB:Help desk/archives/archive 25#Mixed up series). That said, it is possible to have multiple deletion candidate categories/subcategories for different kinds of deletions requests. I just now added my category to Category:Deletion candidates (directly without using a template). I am not sure if this will be interpreted as a deletion request or allow it to be used as a sort of subcategory for a different type of deletion requests. Uzume 20:00, 12 March 2017 (UTC)

Templates in Notes?

Now that "Author Note" is live, it occurs to me that we may want to add support for Wiki-style templates. For example, if I type {{A|Vernor Vinge}} here, everyone will see Vernor Vinge and be able to follow the link to the ISFDB record. We can add the functionality to the database side if it is deemed desirable. Ditto for publishers. Ahasuerus 23:17, 9 March 2017 (UTC)

That would be very nice :) Annie 23:43, 9 March 2017 (UTC)
OK, template support has been added. At this point the software supports the following three templates in the Note fields:
  • "A", which does what I mentioned earlier, i.e. {{A|Vernor Vinge}} will display a link to Vernor Vinge's Summary page
  • "OCLC", which links to OCLC, e.g. "{{OCLC|880913738}}" will display a link to this OCLC record
  • "LCCN", which links to the Library of Congress, e.g. "{{LCCN|89040470}}" will display a link to this LoC record
We can easily add support for other sites. The only constrains are:
  • They need to have stable URLs
  • They need to allow linking by record number
We may be able to accommodate more complex cases as well, but they will require additional research. ASINs are next on my list. Additional suggestions welcome!
P.S. In case anyone is wondering, the "third party identifiers" that we discussed a couple of weeks ago will use the same logic when implemented. The difference is that using these templates in Note fields allows more flexibility, e.g. "corrected page count from {{OCLC|880913738}}, artist from {{OCLC|880914329}}". On the other hand, a separate field for third party identifiers will support robots like Fixer. Ahasuerus 19:02, 10 March 2017 (UTC)
Can we add a template for Publishers for the Publishers "Notes" field? That will allow the links that connect different publishers (when they move as imprints between publishers and so on) to be spelled in an easier way. Annie 20:01, 10 March 2017 (UTC)
When you have a chance, If you use Scott Thomas here, you get to the page. If you use the same in a note, it gets elsewhere (see my submission here for an example). Is that expected? How can I point to the correct one in this case? Annie 20:16, 10 March 2017 (UTC)
Intra-ISFDB linking templates use the Regular Search logic. If a search string matches only one author name, then the user is redirected to that author's Summary page. If, on the other hand, a search string like "Scott Thomas" matches the names of multiple authors, then the "Search Results" page is displayed.
Granted, it would be easy to change the intra-ISFDB templates to use the Advanced Search logic which supports the "exact" functionality, but there is a catch. An Advanced Search always displays the Advanced Search Results page even it finds only one matching record. That's even worse than the current behavior.
What we need is new logic that would combine the "exact" functionality of the Advanced Search and the automatic redirect logic of the Regular Search. Alternatively, we could change the Advanced Search logic to use the same redirect functionality that Regular Search uses, but I think some editors objected the last time this issue came up.
So expected behavior. No problem - I was not sure if you are aware of it happening. How about allowing to link by number in such cases? Or will that be too much work and not worth it (standard links work after all so one can use that if they wish)? Annie 20:45, 10 March 2017 (UTC)
Let me see if I can tweak the Regular Search logic to accept a new parameter to support "exact" searches... Ahasuerus 22:02, 10 March 2017 (UTC)
Done. "Publisher" has been added as well. Ahasuerus 23:36, 10 March 2017 (UTC)
As far as publishers go, I originally implemented a "P" template, but removed it before installing the patch. The linking problem was even worse: a Regular Search on "Tor" finds hundreds of matching publisher names. Ahasuerus 20:33, 10 March 2017 (UTC)
What is the advantage of adding third party identifiers if we are already implementing them as markup in notes? It seems redundant to me and the only difference is whether they adhere to a structured data relational model or are semi-structured data like those of document-oriented databases (or object-relational databases). Both are searchable but semi-structured data may be better supported with a different query language (e.g., XQuery, XPath or SPARQL, etc. vs. SQL). The one downside to this new markup is we are effectively creating our own template processor, macro or lightweight markup language (which can be nontrivial) and we might be better served to use an existing one (which could solve other problems too like restricting the types of markup available instead of making raw HTML available which can be unsafe e.g., if I can get it past moderation which might not be hard since it has no real display, I could add a script tag with JavaScript to note records, etc.). I would recommend adopting an extended (with our identifier markup extensions, etc.) version of reStructuredText (good support in Python and it is becoming a ubiquitous de facto standard in places like GitHub, etc.). I realize updating all the existing notes would be a large task but it could eventually prove worthwhile (and we could implement an interim solution supporting both until they are all converted). Uzume 20:57, 12 March 2017 (UTC)
As I mentioned earlier, "the difference is that using these templates in Note fields allows more flexibility, e.g. "corrected page count from {{OCLC|880913738}}, artist from {{OCLC|880914329}}". On the other hand, a separate field for third party identifiers will support robots like Fixer."
Fixer's internal database contains hundreds of thousands of ISBN-less records. Most of them have a third party identifier like an ASIN, an LCCN or an OCLC number. Fixer can't submit them because he has no way of knowing if they are already in the ISFDB database. Once we add support for third party identifiers, it will become possible for Fixer to start submitting them.
As far as inserting malicious JavaScript into Notes goes, does adding support for templates make a difference given that we already support a subset of HTML in notes?
Re: using a third party template processing tool like "reStructuredText", what would be the advantages? As far as I can tell, the software already supports the limited template functionality that we need. Ahasuerus 21:13, 12 March 2017 (UTC)
Fixer (and other bots) can be made to use the new template markup for identifiers when making submissions and can query such via a note search (perhaps with an added API for bot ease of use). Search could be adapted to handle searching for so marked identifiers in notes (to ease searching for, e.g., {{OCLC|###}}, etc.). This could be not much different than the current ISBN search API that I believe Fixer already uses to check if records already exist (with ISBN X, etc.). Uzume 21:30, 12 March 2017 (UTC)
I don't think querying the live database would be viable since there are hundreds of thousands of ISBN-less records in Fixer's internal database. Especially considering how long Publication Notes searches take. A better solution would be to take advantage of the fact that Fixer has access to a modified version of a recent ISFDB backup. It would be possible to pre-parse all publication notes and build a table of ASINs, LCCNs, etc that are referenced in Notes.
In any event, there is nothing preventing editors from adding notes like "Not to be confused with {{OCLC|123456}}, a German translation of this book", which would mislead Fixer into thinking that we already have OCLC 123456 on file.
As a general rule, structured data is better than semi-structured notes, which should be used sparingly. Once we add support for third party identifiers, I expect them to be used in the majority of cases with templates only used when more specific information needs to be recorded in notes. Ahasuerus 22:02, 12 March 2017 (UTC)
I am sure the designers of so called NoSQL databases and RDF data models (as used by Dublin Core, BIBFRAME, RDA, ISBD, and other recent bibliographic models) would disagree with statements like "[a]s a general rule, structured data is better[...]" (many applications are moving away from relational fully structured data and towards other models like directed graph models, e.g., Semantic MediaWiki, Wikidata using Wikibase, etc.). That said, I agree it might not be the most applicable solution for our "note" needs (which as you mention might contain ancillary reference comments about other things). Uzume 22:47, 12 March 2017 (UTC)

(unindent) The following templates have been added:

  • ASIN:
  • ASIN-UK: Amazon UK
  • BL: British Library
  • BnF (also "BNF"): Bibliothèque nationale de France
  • DNB: Deutsche Nationalbibliothek

Ahasuerus 20:41, 10 March 2017 (UTC)

"Publisher" has been implemented. Ahasuerus 23:36, 10 March 2017 (UTC)
It would be awesome if a list of these templates displayed when editing, or a link to a help page that lists all of them with examples of how to use each one? ···日本穣 · 投稿 · Talk to Nihonjoe 00:46, 11 March 2017 (UTC)
Good point! I have updated the Edit pages with a link to the list of supported templates. How does it look? Ahasuerus 01:38, 11 March 2017 (UTC)
Looks good. Are the template case insensitive so {{OCLC|880913738}} and {{oclc|880913738}} produce the same thing? ···日本穣 · 投稿 · Talk to Nihonjoe 07:49, 11 March 2017 (UTC)
At the moment the templates are case sensitive, but I guess there is no reason for them to be. Let me see what I can do... Ahasuerus 16:42, 11 March 2017 (UTC)
OK, all linking templates are now case-insensitive. "OCLC", "oclc" and "oClC" should generate the same links. Ahasuerus 19:53, 11 March 2017 (UTC)
Awesome. That should nip that potential issue in the bud. ···日本穣 · 投稿 · Talk to Nihonjoe 23:20, 11 March 2017 (UTC)
Shouldn't other templates like {{BREAK}} be case insensitive too? --Vasha 07:24, 12 March 2017 (UTC)
It's probably better to make it case-insensitive, although {{BREAK}} is a special template with special limitations. For example, you can only have one in a note. Ahasuerus 15:34, 12 March 2017 (UTC)

Author Note in Advanced Author Search

Advanced Author Search has been updated to support Author Notes. Ahasuerus 23:03, 10 March 2017 (UTC)

Can I search for identifiers in our new note markup (FormatNote templates)? If so, why bother with implementing third party identifiers separately? (see my comments above in #Templates in Notes?) Uzume 21:09, 12 March 2017 (UTC)
Answered above. Ahasuerus 21:14, 12 March 2017 (UTC)

Data deletion policy -- proposed language

Starting a new section since the "Author Note" field is now available and the last discussion is kind of buried anyway.

Based on what we discussed earlier and the original Rules and Standards discussion, I would like to propose the following data deletion language:

  • If a living author (or his/her authorized representative) requests that the ISFDB remove the author's detailed biographical information, the ISFDB will comply after confirming the requester's identity. The ISFDB will remove as much biographical data as needed in order to accommodate legitimate privacy concerns while preserving, to the extent possible, the work of the editors who have compiled the data. A note will be added to the author's record stating that some information has been redacted upon request explaining what type of information has been removed and why.

The idea here is to express our intent and codify our de facto policy while giving editors some leeway when dealing with specific requests. Ahasuerus 00:23, 11 March 2017 (UTC)

I am not sure if we need to add it in the language or just in the rules but I think the notice for the removal should list what had been removed (for example removing a birth day when a birth place/country was never entered should be distinguishable from a request to remove both - so that a different editor knows which fields should not be filled in). Alternatively, we can add a new default value of "withheld" valid in each field (including the date ones) - which will serve the same purpose. Annie 00:40, 11 March 2017 (UTC)
I like this, and I agree with Annie. Otherwise, we'll either have people with good intentions filling in "missing" information or people unwilling to fill in unredacted missing information. --MartyD 12:44, 11 March 2017 (UTC)
OK, I have adjusted the proposed language above. I don't think "withheld" would work in his case because it doesn't support birth dates like "1943-00-00" where the "00-00" part has been redacted. Ahasuerus 20:02, 11 March 2017 (UTC)
Yes, I meant the notion of identifying what was redacted, not "withheld". I think your revised wording does the trick quite nicely. --MartyD 11:52, 12 March 2017 (UTC)
I believe we should also codify that such data can be added back upon the requester's death (it ceases to be a privacy issue then; at what point does such such information eventually become public domain without restriction?; there should be some defined end to the redaction). That way such redacting comments can be removed while updating so marked records as long as I add death dates as well. Uzume 21:19, 12 March 2017 (UTC)
True, but I hope it is covered by the "living author" language in the proposed text. Ahasuerus 21:22, 12 March 2017 (UTC)
Fair enough. I often try to kill off authors from Oldest Living Authors (by researching their deaths and adding the data). Uzume 22:05, 12 March 2017 (UTC)
Me too!--Dirk P Broer 23:14, 13 March 2017 (UTC)

Outcome: ISFDB:Policy has been updated with the proposed language. The affected record has been updated and the author has been notified. Ahasuerus 14:54, 15 March 2017 (UTC)

Change for handling suffixes in author legal names

There has been a small change to Template:AuthorFields:LegalName to allow for capturing of suffixes that are part of an author's legal name, when we have evidence that its inclusion in the legal name is actually the case. It should be added to the end of the normal legal name entry separated by a comma (Lastname, Firstname Middlenames, Suffix). --MartyD 13:36, 12 March 2017 (UTC)

Additional cleanup reports made available to all editors

Additional cleanup reports have been made available to all editors. More to come. Ahasuerus 18:54, 12 March 2017 (UTC)

  • Even more cleanup reports have been made available to all editors. In addition, a display bug which affected non-moderators has been fixed. Ahasuerus 14:45, 13 March 2017 (UTC)

Magazine dates cleanup

Here's an idea for a cleanup project: finding magazines whose date is incorrectly set to the exact date of publication rather than the cover date. Checking all magazines with a day value other than 00 wouldn't catch all problems but would be an improvement. (Manageable if you could ignore at a stroke all issues of a magazine that correctly has days.) Once found, fixing the problem would be a bit of a pain because of having to correct the dates of covers and contents too. --Vasha 20:17, 12 March 2017 (UTC)

Why not have the records reflex the exact date of publication when known (some magazines have issues specified by year and month and then complete publication dates also printed within them and sometimes these are intentionally different; some magazines do not associate year and month with issues and we can only use exact date of publication)? Uzume 22:01, 12 March 2017 (UTC)
Well, it's a very longstanding bibliographic practice here and elsewhere to give the date of a magazine as the cover date; the Hugo awards goes with that too. Usually the table of contents, masthead, or cover will say "May" (ergo, date of YYYY-05-00) or "May-June" or "Summer". Only if such a date is found nowhere in the magazine should the publication date be used. And if the cover date is something like "Summer" or "First Quarter" then the format of the date is YYYY-00-00. That isn't controversial, is it? --Vasha 23:22, 12 March 2017 (UTC)
Note: we should probably change Help:Screen:EditTitle#Year to "Date" to match the edit form. Uzume 22:01, 12 March 2017 (UTC)
Help updated; thanks.
Re: the original proposal, it would be nice to see a few examples of incorrectly set dates. Once I have a better idea of the discrepancies involved, I could run a couple of database queries. That should help us determine how many mismatches we are looking at and what types of cases are common. Ahasuerus 22:43, 12 March 2017 (UTC)
re: exhibit A: Clarkesworld (print issues) (Are all those really printed in October 2012?) and exhibit B: Planet Stories: Adventure House Reprints. Uzume 22:56, 12 March 2017 (UTC)
I was actually referring to this where the date of the January 2017 print issue of Clarkesworld is given as 2017-01-12 (the ebook is correctly 2017-01-00). --Vasha 23:22, 12 March 2017 (UTC)
For reference, Template:PublicationFields:Date used at Help:Screen:EditPub#Date currently states books should use stated publication date (where available) but magazines should use stated cover date (even if there is a stated publication date). This seems strange for reprints and such things. It should be noted, magazines cannot really use editorial title dates for anything useful here because typically magazine pubs are grouped by year of editorial (to force the situation for multiple publication runs of a magazine like reprints and ebooks, etc. we create another series of editorial titles to define "another magazine" run; this is why I prefer pub series be used for magazines but we do not currently do that). Uzume 00:02, 13 March 2017 (UTC)

Yearling Newbery

We have three 'yearling newbery' publishers [1]

  • Dell Yearling Newbery
  • Yearling / Yearling Newbery
  • Yearling Newbery

with 9, 1, and 1 publications. Perhaps Yearling Newbery be considered a publication series of the Yearling imprint, or various Yearling imprints, which may or may not have multiple parent publishers. At the moment none of the several 'yearling' publishers, with or without 'newbery' in its name, has a Yearling Newbery publication series. If these were 100 years older I would make Yearling Newbery a publication series, presumably across multiple renditions of Yearling, and eliminate the three publishers listed above.

Three of the publications by these publishers are primary verified including one by me, transient. --Pwendt|talk 16:30, 13 March 2017 (UTC)

The Strugatsky's 'Midday' future history

There's a COLLECTION that's bound to be a variant of this 'novel'. In the light of the afterword, the listing in 'Bibliographisches Lexikon der utopisch-phantastischen Literatur' and the handling of analogous titles like this one it really seems more apt to see this as a COLLECTION: the various 'parts' were and are published independently; there also is virtually no fix-up involved, the stories only are set in various times. Any comments? Stonecreek 17:22, 13 March 2017 (UTC)

Checking FantLab, I see that 4 of the stories were originally published as standalones. The names of the characters were reportedly changed when the stories were added to this book in 1967. So I guess it's a, um, "limited fix-up"? Ahasuerus 17:56, 13 March 2017 (UTC)
I looks like it was a COLLECTION initially but was later often referred to as a NOVEL, even by the authors themselves, for e.g. in Boris Strugatzki's remarks in Werkausgabe #5 which I just skimmed through quickly. He begins the text talking about the novel ("Roman"). Later he writes there that they initially wanted it to be a novel with a consistent story, but then gave up on that and regarded it as a collection of more or less independent, mostly unrelated stories written at different times and on different occasions (page 833). Moreover, there's also PDF with a complete bibliography of Strugatzki's publications in German at Golkonda's website, and the information on page 26 supports that: it's initially listed as a collection there (or "Episodenroman") but later also as a novel. also lists it as a collection ("Полдень, XXII век (Возвращение) — это сборник коротких рассказов" => "a collection of short stories" if Google Translate is correct). However, finally, on page 832 in the aforementioned remarks in Werkausgabe #5 there's a hint that the Strugatzkis revised the texts for a Russian edition of complete works from 2001. These remarks are quite extensive and I don't have the time right now to read it all, but it might turn out from these remarks that there's a COLLECTION (early versions) and a revised NOVEL (later versions). Jens Hitspacebar 18:33, 13 March 2017 (UTC)
Based on the available information it seems all publications in our database are COLLECTIONs and I'll change them accordingly. Stonecreek 19:54, 13 March 2017 (UTC)

Verification sources are now available as templates

Our standard verification sources (see Reference:Verification_Sources) are now available as templates. If you enter {{Tuck}}, {{Locus1}}, etc anywhere in notes, the displayed version will show the complete name of the source. It will also be linked to the corresponding ISFDB (or non-ISFDB, as the case may be) Web page. Ahasuerus 18:43, 13 March 2017 (UTC)

Is there a template for {{SFE}}? Chavey 21:44, 15 March 2017 (UTC)
"Clute/Nicholls", "Clute/Grant" and "SFE3" are currently available. Ahasuerus 21:48, 15 March 2017 (UTC)
Thanks. I didn't think to try the "3". Chavey 03:08, 16 March 2017 (UTC)

Displaying images for mixed INTERIORART/COVERART titles

Earlier today I was looking for something else when I stumbled upon the following FR:

  • Currently, when a coverart title is displayed the thumbnails of the coverart images for the parent title and its variants are displayed at the bottom of the title record. Occasionally, a coverart title is a variant of an interiorart title (e.g. interior art was first publication). I'd like to request that thumbnails for the variant coverart titles be displayed on their parent's title page just as they would be if their parent were coverart.

As a point of reference, we have 326 COVERART titles varianted to INTERIORART titles. It would be fairly easy to do what the FR requests. However, first let's make sure that we understand what the change would entail.

Consider this COVERART title, Black Gods and Scarlet Dreams by Michelangelo Merisi da Caravaggio. The linked Title page displays the cover scan which we have on file for the pub associated with this COVERART title. So far so good.

This COVERART title is varianted to the same artist's Medusa, an INTERIORART title. Since it's not a COVERART title, we display either the scans of the covers of the 4 pubs in which this title appears or, depending on the user's preferences, a link to the "All Covers" page.

If we were to change the display logic as per the FR, the Title page for this INTERIORART titles would display the cover scan associated with the COVERART titles -- if and only if the COVERART title is associated with any cover scans. At the same time we would the lose the ability to view the covers of the books in which this INTERIORART can be found.

Is this a desirable trade-off? Ahasuerus 21:57, 13 March 2017 (UTC)

No. Hauck 07:51, 14 March 2017 (UTC)
Can we have both versions (also known as "have your cake and eat it")? Leave the regular logic in place but add a new link for the special case where interior art is the parent to allow the new logic to be shown? Annie 22:56, 15 March 2017 (UTC)

Should entirety of Diabolical Plots be catalogued?

Diabolical Plots pays pro rates, so I've been cataloguing its fiction even though it's web only. I just noticed that the site describes itself like so: "Diabolical Plots is a Sci-fi/Fantasy zine that covers virtually every media related to the genre from books to movies to video games. This site also features regular content related to the craft of writing." Now, despite that self-designation as a zine, it sure looks more bloggish, not organized into issues and with a lot of chatty posts by the editor. I think it's another one to be treated the same way as, fiction only-- just because it calls itself a zine doesn't mean we have to treat it as one. What do you folks say? --Vasha 23:08, 13 March 2017 (UTC)

FR 980 - Add checkboxes for importing/exporting COVERART and INTERIORART titles

As per FR 980, the Web pages that let editors import and export contents have been modified to allow skipping COVERART and/or INTERIORART titles. If you encounter any problems, please let me know. Ahasuerus 00:15, 14 March 2017 (UTC)

Title/publication page layout synchronized

The other day Uzume pointed out that the layout of the Publication page had gotten out of sync with the layout of the other bibliographic pages. The former had separate boxes for publication metadata, "Contents" and "Verification Status". The rest of the bibliographic pages didn't.

I have modified the Title page to use separate boxes for the following sections:

  • Title Metadata
  • Variant Titles and Serialization
  • Awards
  • Publications
  • Reviews
  • Bibliographic Warnings

Glory Road can serve as an example of a title which has all of the listed sections. Its variant Het Pad van Roem is an example of a minimalistic title. Please note that various bullet lists and tables have been adjusted to align vertically across boxes. As always, you may need to force a page refresh (Control-F5 in most browsers) to see the new layout.

This patch is experimental. It's hard to explain visual design in words, so I figured it would be easier to tweak the layout of one page and gather feedback. Once we agree on the optimal layout, I will implement the changes across all bibliographic pages. Ahasuerus 20:08, 14 March 2017 (UTC)

I think I like it. Have to look some more to be sure. --Vasha 20:11, 14 March 2017 (UTC)
I like it. It makes it easier to see where each section begins and ends. ···日本穣 · 投稿 · Talk to Nihonjoe 20:57, 14 March 2017 (UTC)
It pushes the publications way too low on the page even for cases where there aren't that many variants or awards... Can we add links in the top section that allows you to jump to a lower one? If this is doable, then I think it will look better. Also - don't "Bibliographic Warnings" belong only to the publications while reviews are tied to titles. It almost feels like the warnings should be moved to a separate page (similar to the BREAK for notes) so that a casual user do not see them... Annie 21:12, 14 March 2017 (UTC)
And one more thing. Looking at Weirdbook #33, it is hiding all empty sections except for that last "Bibliographic Warnings" one - which is empty but still shown. Shouldn't that be treated consistently? Annie 21:17, 14 March 2017 (UTC)
You have a point about publications being low. But I think the variant titles should still be above the publications anyhow. Makes more sense that way. --Vasha 21:28, 14 March 2017 (UTC)
Thus my question of having in-page links so people can jump into what they are interested. I never proposed to change the order. :) Annie 21:43, 14 March 2017 (UTC)
Some minor glitches (all seen on Firefox 52/Ubuntu):
  • the right bracket of the "[edit]" link next to the ID is overlapping with the border on the right. It needs a small margin on the right.
  • the "Awards" box needs a small margin at the bottom (like e.g. the "Variant Titles" already has) because right now it is almost touching the lower border —The preceding unsigned comment was added by Hitspacebar (talkcontribs) .
Also happening with Chrome. All boxes could use a right side margin (see pub table and pub pictures). -- JLaTondre (talk) 22:37, 14 March 2017 (UTC)
Regarding Annie's comment: It would be nice to tighten up some of the spacing. Reduce the divider between boxes, reduce white space before (slightly) and after the Variant Titles, Serializations, Publications, etc. headings. The text size for those headings could be reduced slightly as well. -- JLaTondre (talk) 22:37, 14 March 2017 (UTC)
Working on it... Ahasuerus 22:51, 14 March 2017 (UTC)
I like these suggestions, along with the one above about having "Jump to:" links. If we have those links, it may be good to add "Return to top" links, too, at the bottom of each section. ···日本穣 · 投稿 · Talk to Nihonjoe 22:50, 14 March 2017 (UTC)

(unindent) OK, the spacing has been adjusted. Please use Control-F5 to load the new layout. (There is more white space between the word "Publication" and the table that follows it than in the other boxes; it will take another patch to get everything in sync.) Ahasuerus 00:06, 15 March 2017 (UTC)

Fixed. Ahasuerus 18:53, 15 March 2017 (UTC)

Re: the "Publication" box being too far down, I have a different idea.

At this time the second box from the top contains a list of VTs and a list of serializations (if they exist.) We can reorganize it as follows:

  • Do not display the name of the VT's/serialization's author if it is the same as the name associated with the canonical title. We don't display it on Summary pages and it will free up a fair amount of screen real estate.
  • Take advantage of the freed up real estate and display the VT/serializations as a table with four columns: VTs, translated VTs, serializations, translated serializations. This is something that was requested a couple of years ago, but we had to have the language assignment process completed first.

This will reduce the amount of "stuff" between the box with the metadata and the "Publications" box. Ahasuerus 00:06, 15 March 2017 (UTC)

Nice thought; I'd really like to see how that looks. How will it work on narrow screens though?--Vasha 00:18, 15 March 2017 (UTC)
Well, at most the new table would contain 4 columns. That's not too bad considering that the "Publications" table contains 11 columns. Ahasuerus 00:23, 15 March 2017 (UTC)

Bibliographic Warnings

There is a fair amount of history here. Back in 2006, i.e. when the first version of the "ISFDB 2.0" software was released and submission moderation was enabled, our data was very (and I mean very) dirty. For example, one of our original robots had run amok and imported thousands of "out of scope" records from library catalogs. Many other records were missing even the most basic bibliographic data.

During that era, title-level bibliographic warnings were useful because they let you identify potential problems with multiple publications at a glance. However, as data quality improved, the usefulness of bibliographic warnings declined. These days, if a publication record doesn't have some bibliographic information, chances are that there is a good reason for that.

All of the above explains why:

  • bibliographic warnings are now disabled for unregistered users
  • registered users can disable bibliographic warnings under User Preferences
  • the logic behind bibliographic warnings has been repeatedly fine-tuned, e.g. to ignore missing ISBNs for books published before ISBNs were introduced

Having said that, as long as the user chooses to to view bibliographic warnings, I think it is useful to display the word "None" if the logic finds no missing/suspicious data. Ahasuerus 00:39, 15 March 2017 (UTC)

New day, new thing to learn. :) Maybe reverse the default for them? I'll admit I never realized I can fully disable them but then I had not looked at this page for awhile (and when I did, I am not sure I knew what all those are so I just left it to show everything). :) Thanks for the explanation! Annie 01:09, 15 March 2017 (UTC)

2017-03-15 downtime

We are getting low on disk space, so it's time to purge Wiki history again. All but the last 50 versions of each Wiki page will be deleted.

The server will be unavailable between 10:30am and 10:50am server time. It's possible that it may take even longer. Ahasuerus 14:06, 15 March 2017 (UTC)

Everything should be back up. Ahasuerus 14:44, 15 March 2017 (UTC)

Templates for SFE3 and FantLab

SFE3 and FantLab are now supported as templates -- see Help:Using Templates and HTML in Note Fields for details. Ahasuerus 14:27, 15 March 2017 (UTC)

If you are taking requests for other languages, SFBG ( , and will be very useful for anything in Bulgarian (which I am still planning to start working on - I guess waiting to add Translator support will be waiting too long). The codes are stable (and once this is incorporated, the owner of the site is willing to send lists of changed codes if that ever happens (usually for disambig reasons and really rarely). Annie 19:02, 15 March 2017 (UTC)
Done. And yes, translator support is the big elephant in the room. I am currently working on less impactful FRs while considering various design approaches. Ahasuerus 19:26, 15 March 2017 (UTC)
Consider faster (she said looking innocently). :) Annie 19:28, 15 March 2017 (UTC)
Unfortunately, I am still waiting for medical nanobots to be perfected. However, the latest combination of drugs seems to give me more energy, so I guess the answer is "Maybe" :-) Ahasuerus 19:40, 15 March 2017 (UTC)
I have a weird idea about translators... why not create a template for adding a translator to a note - that for now will just print the names with some prefix but then when we figure out how we will support them can automatically start forwarding to where they belong (author pages, new pages, whatever)? Worst case scenario - they never link but at least they are uniform enough and thus convertable if we decide something else. If you go for that, it needs to be a three part one and two part one (Translator|name|transliteration) and just (Translator|name). Or we can leave the transliteration alone and just have the name as credited in the book. Annie 19:53, 15 March 2017 (UTC)
It would be easy to create a new template (let's call it {{Tr}} for now) that would have the same functionality as {{A}}. It would work well for certain translators like Brian Stableford and Michael Kandel who are also authors in their own right. It would be less useful when the translator hasn't written any SF. My primary concern is that it could confuse some users who, after clicking the link, would get something like "A search for 'F. Lancel' found 0 matches". Let me think about it some more... Ahasuerus 20:22, 15 March 2017 (UTC)
Don't make it a link initially - at least it will be standardized and can be changed later to a link. Baby steps - no matter how you implement the support, having all translators noted the same way cannot hurt and will allow automatic conversion. Annie 20:37, 15 March 2017 (UTC)
My idea is to basically prepare for either linking (so change the template, the already entered will work with no change) or for moving to a separate field/relationship - in which case a predefined format will help. It is the same as making a rule except that with a rule we will need to be careful for punctuation and what's not - this will clean up the view so we know where the name ends, will ensure that multiple translators are entered consistently and will allow counting to be done in the DB (and even determine when we have a lot of repetitions). Not best use of templates - but best way I can think of to prepare the data (and after all the cleanup I did in the last months, prepared data (the Italian magazines translations for example) is better than having all kinds of weird conventions and manual parsing and reading long messages to find the info you need. Annie 20:56, 15 March 2017 (UTC)
Oh, I see. It's a thought. Let me see what I can do... Ahasuerus 21:20, 15 March 2017 (UTC)
OK, I have created a new template, "Tr", on the development server. If you enter {{Tr|Brian Stableford and Rob S. Pierre}}, the note field will display "Translated by Brian Stableford and Rob S. Pierre". Any additional information like "as by Jean Valjean" will have to be added manually. It's far from perfect, but it can be viewed as the "low hanging fruit" of this thorny issue. Is this what you had in mind? Ahasuerus 22:02, 15 March 2017 (UTC)
Yep. Any chance to allow {{Tr|Елена Павлова|Elena Pavlova}} that gets populated as "Translated by Елена Павлова (Elena Pavlova)"? If not, will {{Tr|Елена Павлова (Elena Pavlova)}} work? Then all we need is a decent set of conventions (always use "and" for multiple translators for example) and we will at least have the data look the same (and downstream can keep playing with it).Annie 22:16, 15 March 2017 (UTC)
{{Tr|Елена Павлова (Elena Pavlova)}} should work. Actually, rereading what I wrote above I see that I was unclear. I should have written "Any additional information like "as by Jean Valjean" can be added manually as part of the template parameter". Thus {{Tr|Brian Stableford and Rob S. Pierre as by Jean Valjean}} will be displayed as "Translated by Brian Stableford and Rob S. Pierre as by Jean Valjean". Of course, you can also choose to put "as by Jean Valjean" outside of the scope of the template. Sorry about the confusion! Ahasuerus 22:28, 15 March 2017 (UTC)
OK... The problem with this approach is that this will make it very hard to just lift and put directly into a field/point to an author automatically. The multiple translators probably will need manual intervention anyway (unless if someone adds the template twice but for transliterations I kinda want to make it easy to just get the second part, ignore the third during a migration - so it can be automated. And adding it outside of the template defeats the purpose of trying to standardize.
Here is an example. A lot of stuff was translated through Russian into a lot of the Eastern European languages. So a statement such as "Translated by Име(Ime) from the Russian." will now become "Translated from the Russian. {{Tr|Име}}. If I add (Ime) in brackets or after the statement, we won't be able to run a script that says: "Look for "{{Tr|Име}}". If found, delete from notes and use "Име" to add to new field/link to author. No manual cleanup needed. Allowing the triple format, will allow you to just ignore the last part if we are linking to authors links (as we will have transliteration there already and it may be different from what will be here - as it may be common name and not exact transliteration) or keeping it with us if we are moving that to a separate section. :)
Now - if that is too complicated, I am fine with what you have now. I am just thinking of the best way to allow automation to help us when we need to change those - which is why I also want the template to start with. Annie 22:50, 15 March 2017 (UTC)
[After sleeping on it.] I think my main concern is that any kind of automation would be tricky to pull off, especially given the fact that our design hasn't been finalized yet. There are all kinds of cases that will require manual review, e.g. "Translated by Michael Kubiak (chapters 1 to 7) and Frauke Meier (chapters 8 to end of novel)" or "Translated by the author and Cecil Hemley" (real life examples.) For this reason I view the "Tr" template as a tool that will make it easier to enter and find translation credits rather than as a tool that will facilitate automation. Ahasuerus 20:20, 16 March 2017 (UTC)
That's fine. At least it will allow an easy report on them for manual migration. And yes - there will be corner cases but if used carefully, it will allow some automation. Maybe. I just think that we are overthinking the corner cases - most of those credits will be a very straightforward single name. Anyway - still better to have it than not - even if it is just to structure the statement better and allow easier finding of cases where it is there. And it should be easier to recognize when it is just a name and when it is more (manual move of the ones that are not just names leaving just names behind as we did with languages/English for example. So are we getting "Tr" as a template? :) Annie 20:26, 16 March 2017 (UTC)
Done -- see the announcement below. Ahasuerus 20:55, 16 March 2017 (UTC)
More seriously though - I will start with the Bulgarian authors I think, giving it some more time. Thanks for adding it. Annie 19:28, 15 March 2017 (UTC)
One for the Deutsche Nationalbibliothek would also be useful. --Vasha 19:43, 15 March 2017 (UTC)
It's cleverly disguised as "DNB" ;-) Ahasuerus 19:46, 15 March 2017 (UTC)

Charles Robinson, Charles Robinson

Our Author record 88489 conflates two illustrators

The header data including all 5 webpages belong to Charles Heath.

So do all the pre-1970 titles and the 1998, 2000, and 2003 COVERART.

LC Catalog credits young Charles for all of our 1970 to 1982 COVERART book titles except the 1976, not found there.

There are some more 1970s/80s titles, INTERIORART only.

I suggest that young Charles gets all 1970s/80s titles.

--Pwendt|talk 19:21, 15 March 2017 (UTC)

I found more info on young Charles Robinson [2] and added him at WikiData. Here I will now begin to disambiguate him as "(I)" --so that Charles Heath retains numeric id 88489. This should proceed publication by publication if/where that works to cover titles uniquely. Right? --Pwendt|talk 19:59, 17 March 2017 (UTC)
7 PubUpdate in the queue as I depart. The remaining 1970s/80s titles (6) appear in multiple publications (5) or belong to Charles Heath (1 or 2). --Pwendt|talk 20:59, 17 March 2017 (UTC)

Title page changes -- VTs

The VT/Serializations section of the Title page has been changed. VTs' authors are no longer displayed if they are the same as the parent's authors. If authors are displayed, they use the standard "as by" syntax and square brackets, e.g. see Glory Road and Inferno. Ahasuerus 21:19, 15 March 2017 (UTC)

Phase 2: The way VTs are displayed has been altered as per our earlier discussion. The new section is called "Other Titles" and contains a table with up to 4 columns. The columns are as follows:
  • Variant Titles
  • Translations
  • Serializations
  • Translated Serialization
"If This Goes On —" provides an example of a table with all four columns. "Coventry" shows a more common scenario with only 2 columns. Glory Road has 3 columns. To Sail Beyond the Sunset has only one column.
These changes are still raw and may need tweaking. For example, this section is currently called "Other Titles", but only because I couldn't think of another term that would encompass all possible permutations. Ahasuerus 23:47, 15 March 2017 (UTC)
I like it a lot. Maybe use "Other versions" instead of "Other titles"? Annie 23:50, 15 March 2017 (UTC)
Looks good! To make it look more consistent with the other tables the <li> elements should be removed and instead an even/odd style added to the rows (same way as in "Publications" table). Also some padding of the table cells left and right would be good. Jens Hitspacebar 23:57, 15 March 2017 (UTC)
For even better readability the year and language could be put into separate columns, with the main table header spanning two or three columns and the second row containing the column header for each row. Jens Hitspacebar 00:02, 16 March 2017 (UTC)
OK, the bullets have been removed. I'll see what I can do about adding alternating background colors tomorrow morning.
I am not sure about having separate columns for years and languages: the worst case scenario would be 10 columns (2+3+2+3) in the table. I'll have to toy with the table layout. Ahasuerus 03:05, 16 March 2017 (UTC)
Very nice, I like it.--Rkihara 03:12, 16 March 2017 (UTC)
As for my suggestion to split it up into columns: the worst case scenario with 10 columns might indeed look a bit cluttered. Some brainstorming: what if the four "Other Titles" tables would be converted into two different sections containing two tables each - i.e. a grouping of the tables. There are two grouping possibilities:
  1. Grouping by "is it a serialization or not?": One section called "Variants" with tables "Variant Titles" and "Translations"; and a second section called "Serializations" with tables "Serializations" and "Translated Serializations";
  2. or grouping by "is it a translation or not?": One section called "Same-language Variants" with tables "Variant Titles" and "Serializations"; and a second section called "Translations" with tables "Translations" and "Translated Serializations".
As a result it wouldn't look so cluttered. The cost for that would be usage of more vertical screen space and - depending on the amount of data - more scrolling until you get to the "Publications" section. I'm actually not sure right now if that's indeed a better solution, just thinking aloud, but I like #2 better than #1. You'd also get rid of the "Other Titles" term that way. Jens Hitspacebar 09:24, 16 March 2017 (UTC)
It was one of the approaches that I considered earlier this week. As you said, the cost would be losing some of the vertical space that we have just recovered. My plan is to polish the current implementation and then review the alternatives. Ahasuerus 16:33, 16 March 2017 (UTC)

(unindent) Italics removed, background color added. Looking into adding more columns. Ahasuerus 16:19, 16 March 2017 (UTC)

the background colors should be the light shades used for the puolications. --Vasha 17:30, 16 March 2017 (UTC)

(unindent) The "Other Titles" section has been changed as per Hitspacebar's original suggestion. Date, language and title/author are now three separate sub-columns within each column. Some examples:

Re: background colors. As Vasha pointed out, there is a discrepancy between the way "Other Titles" and "Awards" are displayed (darker colors) and the way "Publications" are displayed (lighter colors.) Upon closer examination, it turns out that the "lighter colors" scheme was originally added due to a programming error. Oops! However, we have been using it as part of the standard "Publications" table for about a year now and there have been no complaints. On the other hand, there are plenty of other tables which use the original, darker, scheme starting with the Forthcoming Books page. I guess the question is whether we want to standardize the color scheme and, if so, which scheme we want to pick. Ahasuerus 19:38, 16 March 2017 (UTC)

Did you loose the language in the translated serializations somewhere? :) Annie 19:44, 16 March 2017 (UTC)
Fixed! (Apparently "0" and "1" are not the same thing. Who knew?..) Ahasuerus 19:54, 16 March 2017 (UTC)
I like the darker ones better - just provides better contrast. Annie 19:44, 16 March 2017 (UTC)
Looks better and less cluttered than I feared when I came up with the idea. Actually, I like it a lot better this way. As for the colours: I'd prefer the lighter ones of the "Publications". The darker ones look so... dark :) Jens Hitspacebar 20:09, 16 March 2017 (UTC)

(unindent) Had been looking at some art titles (for example) and the new columns make the view there a bit... weird. I wonder if it is time to have a different view for art titles: 2 columns (one for cover art, one for interior - that is a more meaningful distinction than language here, both having language and year columns.). Any thoughts on that? Annie 20:20, 16 March 2017 (UTC)

Well, COVERART titles can't be serialized, so the way things work now, they can't have more than two columns in the "Other Titles" section. Perhaps we should add a third column for INTERIORART reprints? Ahasuerus 20:30, 16 March 2017 (UTC)
P.S. And, conversely, a "reprinted as cover art" column for INTERIORART titles? Ahasuerus 20:31, 16 March 2017 (UTC)
Well, that would be nice! Stonecreek 21:13, 16 March 2017 (UTC)
My point is that the language distinction is less interesting than the type distinction here. Yes - that will be nice. :) Annie 21:18, 16 March 2017 (UTC)
OK, I have added new columns for various INTERIORART/COVERART combinations, translated and otherwise. Here is what the originally linked COVERART title looks like now. Ahasuerus 22:50, 16 March 2017 (UTC)
And here is an example with all 4 columns for art over here just in case someone is interested. I like it :) Annie 23:05, 16 March 2017 (UTC)

Display parameter for templates in notes

In the course of this discussion, the question arose: would it be desirable to have the option to display a linked record (the discussion concerned authors, but it's not limited to them) with a different link text than the page title? I think yes, and in particular it would be good to be able to display disambiguated authors without the disambiguator which is not very informative. Ahasuerus, if I'm summarizing him correctly, thinks that for the sake of consistency and avoiding any possible confusion, the link text should always be the exact page title. --Vasha 03:30, 16 March 2017 (UTC)

That's right. I hope that "Written by Stephen King (I)" would be more informative and less likely to mislead than "Written by Stephen King". It should alert users to the fact that we have multiple "Stephen Kings" on file and prevent them from jumping to unwarranted conclusions. Ahasuerus 04:07, 16 March 2017 (UTC)
I prefer to see the name as is in our DB as well. Annie 21:22, 16 March 2017 (UTC)

"Tr" template added

A new template, "Tr", has been added -- see Help:Using Templates and HTML in Note Fields for details. As discussed earlier, it's nothing fancy, but using it should make migrating translators to the new system -- once we have it in place -- easier. Ahasuerus 20:55, 16 March 2017 (UTC)

I just tried it, but the template doesn't get parsed. Jens Hitspacebar
Hm, it works on the development server. Investigating... Ahasuerus 21:25, 16 March 2017 (UTC)
Fixed. Apologies, human error. Ahasuerus 21:34, 16 March 2017 (UTC)
Thanks a lot! BTW: I'm on the verge of starting to enter all the nominations for the category "best translation" of the Kurd Laßwitz Prize. Question is: is translator support, which would be able to link the translation to the award, more or less around the corner, i.e. should I wait for it? Otherwise I'd start entering them as "Untitled awards" and rework them later once translator support is done. No pressure, just asking :) Jens Hitspacebar 21:47, 16 March 2017 (UTC)
At this point we have gathered the requirements, which include support for "awards given to translations". They are not final yet, but I think we are pretty close. However, the design hasn't been finalized yet -- which can be a big can of worms -- so I wouldn't say that translator support is around the corner. However, I expect that it will be the next major project that we will tackle (emphasis on "major".) Ahasuerus 22:55, 16 March 2017 (UTC)

Titles with title date before the date of the earlier associated publication

(text moved from this Rule and Standard discussion):

I see that there are 2,098 title records that include the phrase "originally published", "originally appeared", or "originally printed". Ideally, none of those would be necessary because you could just look at the title record and SEE where the first appearance was. But it would take an awful lot of work to achieve that ideal. Chavey 03:03, 17 March 2017 (UTC)

Well... if we all agree that this is what we want to do, 2K are not that many. Plus it can take as long as it takes. Half of them will be as easy as creating the record based on the note; some will need research. Still not undoable. :) Annie 03:22, 17 March 2017 (UTC)
I am afraid there are many more permutations. For example, take "A Bottomless Grave" by Ambrose Bierce. It was first published in 1888, but our earliest pub appeared in 1958. The note field reads "First published in the San Francisco Examiner, February 26, 1888.". There are over 12,000 titles like that although some of them already have the first edition pub on file.
Or take "The Young King": the note doesn't explain where the story first appeared.
OK. So we have more than we thought and it may be a huge project to work through them. There will be some that will never be reconciled (we may know it was in a magazine in 1904 but no clue which issue) - not a reason not to mark them in some way that will allow someone with time and will to do research to reconcile them one day. And the ones that we know the history of? It is not undoable. Just because we may not be able to get them all, should we just give up and just say "oh, well, this train left the station, let's leave it like this"? :) Annie 04:10, 17 March 2017 (UTC)
Oh, I am not saying we shouldn't do it. I am just pointing out that there are some really big and juicy worms in this particular can :-) We'll have to think of ways to create at least somewhat manageable cleanup reports. Ahasuerus 04:16, 17 March 2017 (UTC)
Alphabetically. Decade per decade (starting from current and going back - the very old ones will be the pain to figure out). Random 300 per day. Some other new inventive mechanism :) And then will slowly get fixed. If we can identify the majority of them, reports will be the least of our problem I suspect. Plus - I am willing to speculate that from the 12K you are finding at least some have dates just messed up and need adjustment and not a new pub. Or we have the pub and it just need its content. :) Annie 04:24, 17 March 2017 (UTC)
I'll need to write a query to check how many titles predate their earliest pub. Ahasuerus 03:56, 17 March 2017 (UTC)
That will be an interesting list to look at. You will need to add pub-less titles as well - the ones that the report for pub-less skipped and anything that the report caught but was ignored by a moderator. Some of the ones that are like that (with just a note) are hiding there. Annie 04:10, 17 March 2017 (UTC)

(unindent) Preliminary results excluding publess titles (which are handled by a different cleanup report) and 0000-00-00 pubs:

|      218 | ANTHOLOGY    |
|      700 | COLLECTION   |
|     2891 | COVERART     |
|    20530 | INTERIORART  |
|        8 | EDITOR       |
|    10038 | ESSAY        |
|      423 | INTERVIEW    |
|     5677 | NOVEL        |
|      312 | NONFICTION   |
|      122 | OMNIBUS      |
|     4911 | POEM         |
|     1646 | REVIEW       |
|       51 | SERIAL       |
|    33174 | SHORTFICTION |
|      205 | CHAPBOOK     |

Ahasuerus 04:27, 17 March 2017 (UTC)

These are all titles where the date is before the newest pub in their list? Something does not sound right at all... Some of the containers are because of early ebook that is still missing (unknown ISBN I suspect) but these numbers are way too high. Or am I missing something? Annie 04:36, 17 March 2017 (UTC)
It looks legit to me. Here are some randomly accessed titles: an interview, a review, a serial (an improperly entered date, easy to correct), an EDITOR record, a novel, a poem. Ahasuerus 04:50, 17 March 2017 (UTC)
Time for a cleanup report I guess (with an option for moderators to ignore?)), type by type until we hit the big ones? They need either a note on the discrepancy or it to be resolved. Now that I know about them, they are bugging me - a bibliographic DB should make sense -- and that thing does not... (note to self - next time don't ask questions like that...) :) Thoughts? Annie 05:00, 17 March 2017 (UTC)
Chiming in to say, that when I was going through adding contents to 2016 anthologies/collections last December-January, there were a LOT of reprint stories to be added where we didn't yet have them in the database. If I'd stopped to add the first publication for each one, I wouldn't be finished yet. I just did notes. So yeah, 33,000 short stories to do actually sounds believable, unfortunately. --Vasha 06:22, 17 March 2017 (UTC)
I should start by mentioning that we already have this FR to add a cleanup report which would "verify if the minimum of the publication dates of a title is equal to the date in the title data".
Amusing. As usually my FRs were ignored, I've learned quite early to stop using them. Hauck 18:10, 17 March 2017 (UTC)
Well, at least now there is the warning in the Edit results so it should reduce the number of those (if editors and moderators care enough to resolve the issues that is). May be a few years later but it is a step in the right direction IMHO. Annie 18:27, 17 March 2017 (UTC)
Spot checking the data, I see a few different scenarios. First, we have (apparently) incorrectly entered dates. For example, the current date of the previously linked interview is "1997-00-00", but the first known publication date is "1998-03-00". If the interview was recorded in 1997 and published in 1998, we need to change the title date to 1998-03-00. Similarly, I have seen many introductions which were dated based on the author's signature ("Robert Silverberg, New York City, August 1971") rather than on the date of its first publication. We also have a number of serialized novels whose title date is currently set to the date of the first serialization, e.g. Pellucidar. As per Help:Use of the SERIAL type, "when cataloging novel length fiction, the date of the original serialization is not used and the date of the first book publication is used instead. This is an old (and arguably unfortunate) bibliographic convention, and we follow it." In most cases they should be easy to fix.
Second, we have titles which first appeared in "publications" which we typically do not enter. For example, as per Wikipedia, Tolkien's "Bilbo's Last Song" "was first published on a poster containing illustrations by Pauline Baynes in 1974, the year after Tolkien's death."
Other cases are more straightforward. Of course, some publications will be hard to find due to age, rarity, etc. Ahasuerus 17:45, 17 March 2017 (UTC)
Yes, there will be unresolvable ones(such as Wikipedia) but most of them can be resolved - easily or not. I am just thinking that if we keep ignoring these, the number of titles will multiply and a few years down the road, we will be staring at too many titles to tackle... And in the meantime we have a mix of notes (that cannot be searched well to see how many stories were published in a magazine), wrong dates (that really need fixing) and no notes at all where our data is plain wrong or where it may be correct but noone knows why. I do not expect the DB to be always correct (human beings and all that) but when we know about errors, why not fix them? I have similar misgivings for anthologies and collections (and magazines) with no content but lack of data is a bit better than wrong one:) Annie 18:27, 17 March 2017 (UTC)
I am sure we all agree that errors should be fixed. We just need to come up with the best way to approach the process. For example, suppose we add a new cleanup report. The first time it runs, it finds an 1888 title with no pubs prior to 1896. An editor checks the usual bibliographic sources but doesn't find anything. Should we just "ignore" the title record? Or should we create a new template for these types of situations? Something like {{Unknown1stAppearance}} which would be displayed as "The publication in which this title first appeared is currently unknown" and which would be used by the cleanup report to ignore the title? Ahasuerus 21:26, 17 March 2017 (UTC)
Sorry for going on and on and trying to convince the already convinced :) I was thinking of a new template (which is why I mentioned "marking them" somewhere earlier). This way someone can still figure them out later and we will know that we had looked at these and fixed errors - and they are still standing because we cannot find the bibliographic sources... yet. Annie 21:57, 17 March 2017 (UTC)
What about webzine publications, won't those have to remain as notes? --Vasha 22:17, 17 March 2017 (UTC)
We do not set the date for the webzine-first stories based on the webzine first date though, do we? At least my reading of the rules is that we do not (except for the special cases like that we index which we do index). If we do, then the whole "we do not add webzines" is getting a bit... weird. :) And we need to start talking about that outside of this conversation :) But yes - if it is out of scope here, we will either need to add as non-genre (magazines, newspapers, books) or note (the poster example above for Bilbo). Webzines... hm... comes down to what we count as first date for the story I guess. Annie 22:23, 17 March 2017 (UTC)
Well, if we decide that a web-first publication should not determine the date, then we nonetheless definitely should make a note mentioning that publication. However, I can tell you, from reading the credits/copyrights for all those anthologies I just added, that it is nearly universal for those credits to state a first publication if it's in a webzine; copyright dates are a bit funnier, since some people re-copyright all their stories when they republish them in collections, but if they use earlier copyright dates, then they will always be the date of the web publications. Shouldn't we fall in line with such a universal practice?
One thing that is not consistent is whether such credits pages mention early publications on the author's personal blog or site. Sometimes; more often not. (I know this because I'm in the habit of trying to check these credit pages by googling, and thus I find unmentioned web publications.) --Vasha 22:39, 17 March 2017 (UTC)
Oh, I know. As I said - I think we need to start talking about the web-based stuff again sooner or later - the world is moving, some of our rules do not make much sense in it :) Part of the reason we do not use copyright dates is because it is not always based on a publication. And in the self-publishing world, it gets even trickier (copyright of when they created it and not when published - I was chasing a few of those the last few days). But then "first publication" becomes an interesting concept. And we need a better definition of it for cases like this. Annie 22:46, 17 March 2017 (UTC)
Ooh, I don't envy you trying to identify the first appearance of self-published things! Often, if they've been removed from sale, not much trace of them remains; and if they are still on sale, they may well bear a date on Amazon or Smashwords that has no relation to when they were first sold. Your best hope is if the author provided a good bibliography on their site. Here's offering you some virtual aspirin for the headaches... --Vasha 22:54, 17 March 2017 (UTC)
Well... I am doing some due diligence but if something is untraceable, I use whatever date I can find and note where the date comes from. If one day an older one is discovered, it will get fixed. This whole conversation started because of the dual practice of saying "First published in London News, 25 May 1934" vs creating a record for "London News, 25 May 1934" as non-genre and adding the story there depending solely on how the editor feels about it. In one case it is searchable and we can see how many stories "London News" published; in the other - not so much. It just got a bit bigger because of the way the DB works :) Annie 23:18, 17 March 2017 (UTC)

Amazon Templates stopped Working

The new Amazon templates have stopped linking. They worked great on the first day then stopped.--Chris J 20:33, 17 March 2017 (UTC)

Sorry, it was an unintended side effect of the last template change. Things should be back to normal now, e.g. see this pub. Ahasuerus 21:01, 17 March 2017 (UTC) stories and chapbooks art

We have the series of chapbooks over here and the webzine entries here. The stories are properly merged. The art - not so much :) From the few I looked at, the covers of the chapbooks is the same as the art on the site (which we had indexed). Any objections to varianting them properly (both are always visible - one in Amazon, one in so we will be able to see and make sure they are the same indeed)? Or am I missing a reason not to? Thanks! Annie 22:19, 17 March 2017 (UTC)

Certainly, why not? --Vasha 22:48, 17 March 2017 (UTC)
PS: and it is varianted and not merged because it is covers on the chapbooks :). My initial message does not make that clear. Annie 22:57, 17 March 2017 (UTC)

Publisher page changes

The layout of the Publisher page has been aligned with the recently tweaked layout of the Title pages. Here is an example of what a publisher with a limited amount of data looks like. And here is what a publisher with a lot of data looks like. Ahasuerus 14:13, 18 March 2017 (UTC)

Synchronizing the layout of bibliographic pages

Based on the discussion of the Title page that we had a few days ago, I have further synchronized the layouts of the "content boxes" on the Title, Publication and Publisher pages.

Please note that the layout of what's inside these boxes is still somewhat inconsistent and will be revisited later, but at least the relative position of the boxes, their margins, white space padding, etc are now the same. I plan to make the same changes to all the other bibliographic pages shortly. Ahasuerus 19:35, 21 March 2017 (UTC)

Publication series done. Ahasuerus 21:02, 21 March 2017 (UTC)
Regular (title) series done although the Series Grid page for magazines is still outstanding. If you see anything unusual, please let me know. Ahasuerus 01:59, 22 March 2017 (UTC)
Series grid done. Ahasuerus 19:50, 22 March 2017 (UTC)
Author pages done. Let's see if these changes help with the previously reported "starkness" problem -- see Kim Stanley Robinson, Bob Smith and Bob Smith (I) for examples of long, medium and short Summary pages. Ahasuerus 20:46, 22 March 2017 (UTC)

New: Trackers to help keep up with current short fiction

I've created two wiki pages (with a lot of help from Annie-- thanks again!) that are intended to help with adding newly-published (not reprint) short fiction to the database: the Magazine Issue Tracker and the Anthology and Collection Tracker. They are schedules of expected forthcoming publications that can be used on a monthly basis for database updates; they also show which issues and volumes have contents records.

Please take a look and tell me what you think of the design, and of the "How to Use" information at the bottom of the pages. Improvements will be gratefully accepted. --Vasha 19:53, 21 March 2017 (UTC)

Pretty cool. Thanks for assembling! My two suggestions:
Put a legend of the colors at the top of the table, for quick reference.
Maybe specifically label as 2017? And what will happen when 2017 rolls over to 2018? It will be here before we're ready... Albinoflea 03:40, 23 March 2017 (UTC)
I would think that in 2018, the current tables with data will be moved to an archived page (just so the remaining 2017 ones can be finished) and this one will remain empty again for "Current Year". Vasha, what do you think? Annie 03:45, 23 March 2017 (UTC)
Good thoughts. I will put in a header that identifies this iteration as 2017, but keep the page title generic. And as Annie says, at the end of the year we can put something like a box with links to archived pages at the bottom, and change the header to 2018. --Vasha 04:28, 23 March 2017 (UTC)
Changes made; how's that? --Vasha 04:47, 23 March 2017 (UTC)
I've also lightened up the background colors. --Vasha 05:21, 23 March 2017 (UTC)

Format question: dos vs tp

I had been adding some entries here and it strikes me that most of the records are set to "tp" instead of "dos". As it is a double cover (cover on the back and on the front), double-novel (*novel 60s style anyway), it looks to me like the definition of "dos" and that overwrites the more generic "tp" (anything that is not already covered and is paper)... Am I misunderstanding what "dos" is supposed to be used for? Or do most of these need a format conversion? Annie 23:53, 22 March 2017 (UTC)

Yes, my understanding is that "dos" would take precedence over "tp", but I'm guessing that since the two novels aren't rotated 180º to each other (at least from the cover examples shown) that these might not technically be valid "dos" candidates. At least that's my take. Perhaps the documentation should be clarified. Albinoflea 03:26, 23 March 2017 (UTC)
Hm, I did not think about the rotation (never seen one of the double novels that are usually used for an example) and you are probably right. I think that the help page needs a bit of an update - may be obvious for most people around here that they need the rotation but it tripped me. Thanks! :) Annie 03:43, 23 March 2017 (UTC)
Only if it's rotated and a part therefore readable from the back, or if there are two backs glued together it's a dos. That's how I understood it so far. The Dos-à-dos binding Wikipedia article has a good description. Jens Hitspacebar 11:21, 23 March 2017 (UTC)
That is explaining a rotation on the other axis from what I was thinking. Still not what Armchair fiction are doing though so I will fix those. Now you made me want to go and find one of the Ace doubles just so I can look at the thing... Annie 17:55, 23 March 2017 (UTC)

David Gemmell Award

Can we add this award to the available awards in the database? It's a popular vote (people vote on the website) set of awards given out each year (since 2009 for the Legend Award, and 2010 for the other two) for fantasy books. There are three specific awards:

  • Legend Award - awarded to the fantasy title judged the year’s best, as chosen by open vote
  • Morningstar Award - awarded to the the author judged to have made the year’s best debut in fantasy fiction, as chosen by open vote
  • Ravenheart Award - awarded to the artist(s) responsible for the year’s best fantasy book cover art, as chosen by open vote

The short name for the award is "Gemmell Award". The website for the award is ···日本穣 · 投稿 · Talk to Nihonjoe 21:32, 23 March 2017 (UTC)

Their online voting system is somewhat unorthodox, but I recognize the people who administer the award as established professionals. Hopefully they have added safeguards to prevent multiple voting and such. Otherwise the awards look legitimate and I have no objection to adding them. Ahasuerus 00:43, 24 March 2017 (UTC)
Okay. Let me know when it's been added and I'll populate it. ···日本穣 · 投稿 · Talk to Nihonjoe 19:01, 24 March 2017 (UTC)

Add language request

Can Akkadian be added as a language selection? I'm concerned with The Epic of Gilgamesh. Thanks, Ldb001 14:20, 24 March 2017 (UTC)

Akkadian is an ISO-2-recognized language (language code akk), so it shouldn't be a problem. Let me double-check with Linguist to see if there is anything else we may need to add to support Gilgamesh. Ahasuerus 14:28, 24 March 2017 (UTC)
No problem with Akkadian as a language. But remember that the original language of The Epic of Gilgamesh is Sumerian, which is utterly different… Linguist 14:33, 24 March 2017 (UTC).
Should we add both Akkadian ("akk") and Sumerian ("sux") then? They are both ISO-2-recognized languages, so it wouldn't cause any issues. Ahasuerus 15:09, 24 March 2017 (UTC)
Might as well. As the French idiom goes, ça ne mange pas de pain (there's no harm in it) :o) Linguist 15:19, 24 March 2017 (UTC).
Done! Ahasuerus 15:45, 24 March 2017 (UTC)
Thank you for taking care of that so quickly! My friend wikipedia tells me that the two surviving tablet sources of the epic proper are in Akkadian and Old Babylonian (which is called a dialect of Akkadian). Some older Sumerian associated material also exists. I'm sure that modern texts draw from all sources to make as complete a version as possible, but because the Akkadian source is more complete, for shorthand Akkadian seems to be a good choice. I have no knowledge of what proportions of what sources have been used for this translation.
I don't know protocol for including a hypothetical (lost) original form which may have been in Sumerian. At any rate the Akkadian/Babylonian is apparently the oldest version of the epic that exists. Thank you again for the language support, Ldb001 22:53, 24 March 2017 (UTC)
Personal tools