These publishers granted us permission:

publisher, Medline size, gene content Terms of Service allows Text Mining? UC Library License allows Text Mining? Contact First contact Got permission? Crawling success
Elsevier, 1670771 articles (0.19)

No: "You may not engage in systematic retrieval of the Site"

Not explicitly prohibited:

Raphael Sidi, VP Product Management ScienceDirect, Oct 2009, again in June 2011 Yes, Dec 2011, mining license bound to SciverseApp, developed App for Elsevier 81% why?
Wiley, 965396 articles (0.20)

No: "users may not "download and/or store an entire issue of a Electronic Product or its equivalent;"

Yes: "9. licensee has the right to index, search and data mine the digital copy (...) as long as it does not impede Wiley's servers or service in any way. All such processes are solely for the internal teaching, learning and research purpose of the Licensee"

Duncan Campbell, Associate Director, Journal Digital Licensing, Jan 2012 Yes, May 2012 25% why?
Wolters Kluwer, 653390 articles (0.14)

No: "Any reproduction, distribution, performance, display, preparation of derivative works based upon, framing, capturing, harvesting, scraping, or collection of, or creating of hypertext or other links or connections to, any Site Materials or any other proprietary information of WKH, without WKH's advance written consent, is prohibited."

Yes: In addition to the Permitted Use above, solely with respect to Lippinctt Willians & Wilkins Journals ordered by Subscribe hereunder: (...) Authorized Users may use the products to engage in text mining/ data mining activities for legitimate academic research and other educationl purposes

Andrew Richardson, VP Business Development, 04/01/12 Yes, Feb 2012 1% why?
Oxford University Press, 205191 articles (0.24)

Maybe: The materials on our website may be retrieved and downloaded solely for personal use.

Not explicitly denied:

Richard O'Beirne, Digital and Journals Strategy Manager, Apr 2012 Yes, Apr 2012 (quick!) 9% why?
Nature Publishing Group, 200270 articles (0.25)

No: "You may not (...) (b) copy, download, or store any content, files, feeds or data from the Site, whether publically available or not, to make or populate a database or publication of any kind whatsoever"

Explicit: No: the Licensee warrants (...) that it will not (...) (j) make mass, automated or systematic extractions from or hard copy storage of the Licensed Material

David Hoole, Director Brand Marketing and Institutional Relations London, Alf Eaton in Nov 2009, David Hoole in Aug 2011 Yes 46% why?
Informa Healthcare, 175365 articles (0.15)

No: "the systematic downloading of content without a written licence, will result in access to the site being blocked"

Yes: Authorized Users may use the material to engage in text mining

Ian Bannerman, Managing Director Journals, Feb 2012 Yes, Refused. Ongoing discussions. 1% why?
American Society for Biochemistry and Molecular Biology, 67642 articles (0.58)

No explicitly:

No explicitly:

Andrew Harmon, Science and Publishing Technology Manager, Feb 2012 Yes, Mar 2012, (Highwire) 2% why?
American Society for Microbiology, 64006 articles (0.41)

No:

Alex Collery, Feb 2012 (Highwire) Yes 65% why?
American Association for Cancer Research, 25929 articles (0.43)

Yes: "shall be permitted to extract or use information contained in the licensed materials for education, scientific or research purposes"

Feb 2012, retried in Apr 2012 Yes 0% why?
American Association of Immunologists, 22728 articles (0.35)

No license?

:

Claire Sinks, Content Licensing Manager, Apr 2012 Yes, May 2012 98% why?
Company of Biologists, 18461 articles (0.39)

"Prepare derivative works or download, mount or distribute any part of the Licensed Material on any electronic system or network"

:

Jane Pennington, Subscription Sales & Marketing, Apr 2012 Yes, Nov 2012 99% why?
Portland Press, 16539 articles (0.46)

 "systematic downloading of content without a written license, will result in access to the site being blocked"

: No license

Caroline Black, Managing Director Mar 2012 Yes, Apr 2012, can crawl Biochem Journal, Biochem Soc Trans 2% why?
Royal Society, 14906 articles (0.08)

Yes: Licensee may (...) Use Text Mining technologies to derive information from the Licensed Materials.

:

Stuart Taylor, Commercial Director May 2012 Yes 5% why?
Society for General Microbiology, 13642 articles (0.60)

:

Karen Rowlett, Managing Editor IJSEM, Mar 2012 Yes, Apr 2012, four journals, see link, (highwire), send results 100% why?
American Society for Pharmacology and Experimental Therapeutics, 12112 articles (0.36)

No: "The person using an American Society for Pharmacology and Experimental Therapeutics journal may view, reproduce, or store copies of articles comprising the journal provided that the articles are used only for their personal, non-commercial use."

:

Richard Dodenhoff, Apr 2012 Yes, Apr 2012 (UCSC has no sub, but back content 1997- crawlable) 94% why?
Rockefeller University Press, 10767 articles (0.39)

No: "The user may not (...) make available a mirror site of the RUP web site, any of its constituent journal web sites"

:

Gregory Malar, Business Development Director, Mar 2012 Yes, Apr 2012 (+highwire account) 97% why?
Genetics Society of America, 6500 articles (0.46)

: no license

Scott Hawley/Tracey DePellegrin Connelly Aug 2009 Yes, March 2010 97% why?
Federation of American Societies for Experimental Biology, 5883 articles (0.46)

Not explicitely

:

Barbara Walker, Content Licensing and Sales Manager, Apr 2012 Yes, July 2012 98% why?
Royal Society of Medicine Press, 1 articles (NA)

Yes: authorized users may "use Text Mining technologies to derive information from the Licensed Materials"

:

Jeremy Theobald, Head of Publishing Feb 2012 Yes 0% why?
The British Society of Immunology, 1 articles (NA)

:

Daniel Price, Education & Communication Officer, Feb 2012 Yes, Mar 2012, but download/license via Wiley 0% why?
Society of Molecular Biology and Evolution (Journal: Mol Biol and Evol), 1 articles (NA)

See Oxford University Press

Not explicit:

Ken Wolfe/Cathy Kennedy Feb 2011 Yes, Nov 2011 0% why?
The Genetics Society (Heredity), 1 articles (NA)

Explicitly yes, but see Nature Publ Group for our separate agreement

:

Yes, July 2009 0% why?
Future Science Group, 1 articles (NA)

No: "systematic downloading of content without a written license, will result in access to the site being blocked"

:

Elisa Manzotti, Publisher, Mar 2012 Yes, Apr 2012, project progress updates 0% why?
Am Soc of Plant Biologists (Plant Phys, Plant Cell), 1 articles (NA)

No license?

: No license

Nancy Winchester, Publications Director, Mar 2012 Yes, Mar 2012 (We have no site license. up to 76% is open-access, check: not marked as OA in PMC?) 0% why?
American College of Chest Physicians (Chest), 1 articles (NA)

No:

:

Carla Miller, Assistant Editor, Jul 2012 Yes, Aug 2012 0% why?

No permission yet from these:

publisher, Medline size, gene content Terms of Service allows Text Mining? UC Library License allows Text Mining? Contact First contact Got permission? Crawling success
Springer, 440469 articles (0.18)

No: "User may not modify, remove, delete, augment, add to, publish, transmit, participate in the transfer or sale of, create derivative works from, or in any way exploit any of the Content, in whole or in part.

Yes: “User may not systematically download any content except for legitimate research purposes”

Wim van der Stelt, Executive VP Corp Strategy, Feb 2012, stalled, restart in Nov 2012 via Wim van der Stelt No 3% why?
BMJ Group, 115833 articles (0.07)

No: Systematic Download is prohibited

No reply yet No, Feb 2012 2% why?
Sage, 102460 articles (0.17)

Yes: "may extract or use information contained in the licensed materials for education, scientific or research purposes"

Feb 2012 No, No reply 2% why?
Karger, 61246 articles (0.17)

Yes: "shall be permitted to use information contained in the licensed materials for education, scientific or research purposes"

B Reigber S. Mattern, B.Reigber No, Feb 2012, retried in Apr 2012 0% why?
Mary Ann Liebert, 54117 articles (0.30)

Yes: Licensed material may be used for purposes of research

Feb 2012 No 0% why?
American Physiological Society, 53531 articles (0.29)

Yes: "shall be permitted to use information contained in the licensed materials for education, scientific or research purposes"

Mark Goodwin, Editorial Manager, Feb 2012, retried in Apr 2012, retried 4 times No 0% why?
American Medical Association, 45707 articles (0.04)

:

:

Feb 2012, retried in Apr 2012 No 0% why?
National Academy of Sciences, 45517 articles (0.39)

No: "systematic downloading is prohibited"

: No license

Feb 2012 No 77% why?
Bentham Science, 27740 articles (0.26)

Yes: Not specified

: No license

Richard E. Morrissy, USA Office No, Mar 2012, again in Apr 2012 1% why?
American Society of Hematology, 19038 articles (0.32)

No: "No part of the publication may be reproduced (see exception below), stored in a retrieval system, translated, or transmitted in any form or by any means now or hereafter known, electronic or mechanical, without permission in writing from the publisher, The American Society of Hematology (ASH)."

:

Julie Robertson, Marketing and Advertisigin Coordinator Mar 2012 No, Refused: "Text mining is a service we would not be pursuing at this time." 0% why?
Landes Bioscience, 13054 articles (0.38)

No: "Nothing contained on the Website will be construed as granting, by implication or otherwise, any right to use, reproduce, modify, transmit, display, publish, sell, create derivative works, publicly perform, or distribute by any means, method, or process whatsoever, now known or hereafter developed, any of the Content on or transmitted through the Website for commercial purposes."

:

Cynthia Conomos Mar 2012 No 3% why?
Cambridge University Press, 1 articles (NA)

No: you agree NOT to "Engage in systematic copying or downloading of the Materials or transmit any part of the Materials by any means to any unauthorised user"

Yes: No explicit language prohibiting mining or systematic download

M Anderson, Feb 2012, retried in Apr 2012 No 0% why?
American Assoc for the Advancement of Science, 1 articles (NA)

Probably not: Does not address question

Feb 2012 No 0% why?
IOS Press, 1 articles (NA)

No: user is not allowed to "systematically make print or electronic copies of the item(s)"

No: No license

Astrid Engelen, Head of Marketing Feb 2012 No 0% why?
American Soc of Clin Oncology (Journal of Clinical Oncology), 1 articles (NA)

No: using manual or automated software, devices, scripts, robots or other means or processes to access, "scrape," "crawl," or "spider" any Content contained on the Website;"

:

No, Mar 2012 0% why?
The Endocrine Society, 1 articles (NA)

No: "Permitted access by authorized users includes searching, downloading, printing and storing of individual articles for scholarly research, educational and personal use. "

:

dbyrnes Feb 2012 No 0% why?
The Society for Neuroscience, 1 articles (NA)

No: "Systematic downloading is prohibited."

:

jperry Apr 2012 No 0% why?
Others that were contacted in April 2012: Associations of publishers that forwarded our email (thanks!): It is not obivous to find out if crawling is already allowed in the existing license, here is are some public lists of license that I'm using: