fmII
Thu, Jul 24th home | browse | articles | contact | chat | submit | faq | newsletter | about | stats | scoop 01:51 UTC
in
Section
login «
register «
recover password «
[Project] add release | add branch | add screenshot | broken links | change owner | email subscribers | update project | update branch (urls) [Project]

 yahoo2mbox - Default branch
Section: Unix

 

Added: Mon, Jun 25th 2001 12:07 UTC (7 years, 1 month ago) Updated: Mon, Jan 7th 2008 12:00 UTC (6 months, 19 days ago)


About:
yahoo2mbox retrieves the messages from Yahoo! Groups archive and stores them in a local file in mbox format.

Author:
Vadim Zeitlin <vadim [at] wxwindows [dot] org> [contact developer]

Rating:
8.28/10.00 (3 votes)

Homepage:
http://www.tt-solutions.com/en/Products/yahoo2mbox/
Tar/GZ:
http://www.tt-solutions.com/downloads/yahoo2mbox-0.24.pl.gz
Zip:
http://www.tt-solutions.com/downloads/yahoo2mbox-0.24.zip

Trove categories: [change]
[Development Status]  3 - Alpha
[Environment]  Console (Text Based), Win32 (MS Windows)
[License]  Public Domain
[Operating System]  Microsoft :: Windows :: Windows 95/98/ME, POSIX
[Programming Language]  Perl
[Topic]  Internet

Dependencies: [change]
No dependencies filed

 
Project admins: [change]
» VZ (Owner)

» Rating: 8.28/10.00 (Rank N/A)
» Vitality: 0.06% (Rank 1694)
» Popularity: 2.09% (Rank 2445)

project statsdownload stats
(click to enlarge graphs)
   Record hits: 21,101
   URL hits: 9,015
   Subscribers: 54

Other projects from the same categories:
Webmastercart
Pandorabots Chat Bot Interface
ConPresso
pY! Voice Chat
nttlscan

Users who subscribed to this project also subscribed to:
ganttproject
Squirrelmail Outlook Skin Theme
MediaWiki
radare
Distributed Concurrent Versioning System


Add comment · Rate this project · Subscribe to new releases · Ignore this project · Email this project to a friend · Project record in XML

 Branches

Branch Version Last release License URLs
Default 0.24 07-Jan-2008 Public Domain Homepage Tar/GZ

 Comments

[»] Batch file to automate yahoo2mbox
by Locoblade - Jan 7th 2008 13:48:29

Hi All

Having struggled getting my Yahoogroup downloaded in a decent amount of time using yahoo2mbox due to the amount of times my account got locked out by Yahoo, I just thought I'd share the following batch file with you that I wrote that resolved it for me, allowed me to download 60,000 messages in about 4 days without getting locked out.

The script uses 2 usernames/passwords to share the load, so if you only have one username you'll need to register another, although I just used another named profile within the same Yahoo user account as even if one gets locked out, the other seems to continue working.

Copy the entire script below into notepad and save it as runme.bat in a new folder. In the same folder you'll also need the yahoo2mail.pl file and also a file called sleep.exe which you can officially get in the Windows 2003 Resource kit, but there's a version here that will also do the job: http://www.computerhope.com/dutil.htm

Script as follows, copy between the ======

=====================================
@echo off
set /p groupname=Set Yahoo Group Name ...
set /p startat=Set message download start number (usually 0)...
set /p add=Set Number of messages to download each time (Recommend 75)...
set /p delay=Set delay time in seconds (Recommend 2)...
set /p username1=Set Username 1 ...
set /p password1=Set Password 1 ...
set /p username1=Set Username 2 ...
set /p password2=Set Password 2 ...

cls

:initial run
set /a endat=%startat%+%add%
yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat% "%groupname%"
sleep 90

:continue
set /a endat2=%endat%+%add%
echo %endat2%
yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"
set error=%errorlevel%
echo %error%
if not %error%==0 goto retry
set endat=endat2
sleep 90
goto continue

:continue2
set /a endat2=%endat%+%add%
echo %endat2%
yahoo2mbox.pl -user="%username2%" -pass="%password2%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"
set error=%errorlevel%
if not %error%==0 goto retry2
set endat=endat2
sleep 90
goto continue2

:retry
echo %error% >log.txt
yahoo2mbox.pl -user="%username2%" -pass="%password2%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"
set error=%errorlevel%
set endat=endat2
if %error%==0 goto continue2
sleep 900
goto retry2

:retry2
echo %error% >log.txt
yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"
set error=%errorlevel%
set endat=endat2
if %error%==0 goto continue
sleep 900
goto retry2

pause
=====================================

Once you have the batch file, the sleep.exe and the yahoo2mbox.pl file in the same location, run the batch file and it will prompt you for the required information and recommend the delay / download settings I used that seemed to work without overloading the download limits. If it does overload and lock out, it will switch to the second account, which should give time for the first one to unlock again. Once the second one locks out, it switches back to the first one again and so on.

Hope it helps someone.

[reply] [top]


[»] problem with yahoo2mbox
by cmbtr - May 14th 2003 01:20:23

yahoo2mbox version 014 does not retrieve messages
from some yahoogroups where messages archives is closed
and needs a userid and password to login.

there is a long delay after login but no messages are retrieved.

[reply] [top]


[»] Age-Restricted Area of Yahoo! Groups.
by James Erbium - Dec 17th 2002 11:22:51

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
You've reached an Age-Restricted Area of Yahoo! Groups.

This area contains material of a mature and adult nature the may not be suitable for younger users. You must be over the age of 18 to access this area of Yahoo! Groups.

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

Hi...

As you can read the message above, one of my Yahoogroups, "fun_things" is listed as Age-Restricted Area. When I try to download from that group, this message came out "please check if you have specified valid password."

My question, How can we download from this "Age-Restricted Area".

Thank you.

[reply] [top]


    [»] Re: Age-Restricted Area of Yahoo! Groups.
    by VZ - Dec 23rd 2002 10:01:51


    > My question, How can we download from
    > this "Age-Restricted Area".

    Modifying the script to take into account this additional confirmation page should be pretty trivial but as I don't have myself any need for this I don't plan to do it any time soon. Of course, if someone else can make a patch for this, I'd gladly accept it.

    Regards,
    VZ

    [reply] [top]


      [»] Re: Age-Restricted Area of Yahoo! Groups.
      by VZ - Mar 29th 2003 12:16:18


      > % My question, How can we download from
      > % this "Age-Restricted Area".

      I've forgot to mention here that it is possible to do it starting from version 0.12 -- or at least should be, I couldn't test it myself.

      [reply] [top]


[»] failed with yahoo2mbox
by paulus - Nov 7th 2002 07:17:22

yahoo2mbox failed to retrieve message from
yahoogroups and give:
<x-html> tag not found

any idea how to solve this?

thanks.

[reply] [top]


    [»] Re: failed with yahoo2mbox
    by VZ - Nov 7th 2002 14:54:56


    > yahoo2mbox failed to retrieve message
    > from
    > yahoogroups and give:
    > <x-html> tag not found
    >
    > any idea how to solve this?

    I've received the reports about it but I don't really know why does it happen -- so the best would if you could look at the HTML text of the page you're trying to receive yourself. Normally, the text of the message is located inside an tag and without it the script is lost.

    So the questions are: is this tag there? If not, is the message text there? And if it is, is there any other way to locate it?

    Good luck!

    [reply] [top]


      [»] Re: failed with yahoo2mbox
      by Ricardo Gladwell - Mar 26th 2003 03:13:45


      >
      > % yahoo2mbox failed to retrieve message
      > % from
      > % yahoogroups and give:
      > % <x-html> tag not found
      > %
      > % any idea how to solve this?
      >
      >
      > I've received the reports about it but I
      > don't really know why does it happen

      I'm having the same problem although I have a suspicion about the precise cause of the problem: perhaps this has something to do with the advertising pages that Yahoo Groups sometimes inserts when attempting to open particularly mails. How does yahoo2mbox.pl handle these advertising pages if at all?

      [reply] [top]


        [»] Re: failed with yahoo2mbox
        by Ricardo Gladwell - Mar 26th 2003 03:40:02

        This occurs because you have reach your download limit: if you look at the page in question it has the following error: "The message you requested is temporarily unavailable because this group has exceeded its download limit. Please try again later." Since yahoo2mbox.pl appends to an already downloaded list you can simply try the same command again later. :)

        [reply] [top]


          [»] Re: failed with yahoo2mbox
          by VZ - Mar 29th 2003 12:13:54


          > This occurs because you have reach your
          > download limit

          Indeed, thanks for looking into this.

          The trouble is that I still don't know what to do about this. Well, I've at least added a (hopefully) more clear error message and a note about this in the script description.

          [reply] [top]


        [»] Re: failed with yahoo2mbox
        by Paul Wise - Aug 22nd 2003 00:12:49


        >
        > %
        > % % yahoo2mbox failed to retrieve
        > message
        > % % from
        > % % yahoogroups and give:
        > % % <x-html> tag not found
        > % %
        > % % any idea how to solve this?
        > %
        > %
        > % I've received the reports about it but
        > I
        > % don't really know why does it happen
        >

        AFAICS yahoo has changed the ouput of view source
        messages.

        try searching for <!-- start content include -->
        instead of <x-html>. Then you have to deal with
        the multiple <tt> tags, that are used to contain
        different parts of the message. eg the header is
        one tt, the body is another & if the message is
        multipart/mime there will be heaps of <tt>stuff
        here</tt><br> & it all needs to be converted.

        please im/email me if you want a sample

        --
        bye, pabs

        [reply] [top]


          [»] Re: failed with yahoo2mbox
          by paulus - Aug 26th 2003 00:40:10


          > AFAICS yahoo has changed the ouput of
          > view source
          > messages.
          >
          > try searching for <!-- start content
          > include
          > -->
          > instead of <x-html>. Then you have
          > to deal
          > with
          > the multiple <tt> tags, that are
          > used to
          > contain
          > different parts of the message. eg the
          > header is
          > one tt, the body is another & if the
          > message is
          > multipart/mime there will be heaps of
          > <tt>stuff
          > here</tt><br> & it all needs
          > to be
          > converted.
          >
          > please im/email me if you want a sample
          >

          Have somebody been able to solve this "x-html tag not found" error message?
          I use yahoo2mbox 0.14 and the problem still occured.

          [reply] [top]


    [»] Re: failed with yahoo2mbox
    by Kardiman - Aug 26th 2003 17:52:51


    > yahoo2mbox failed to retrieve message
    > from
    > yahoogroups and give:
    > <x-html> tag not found
    >
    > any idea how to solve this? i hope this problem will solved soon

    --
    Keep Amar Ma'ruf Nahi Munkar on the Net, euy!

    [reply] [top]


[»] Helpful
by Adam Byrtek - Feb 25th 2002 17:48:42

Great idea! Very nice little tool, helped me a lot when I
lost my whole group archives.

Thank you, deleloper(s)!

[reply] [top]


    [»] What about files
    by afterburner - Aug 6th 2004 01:29:59

    Hi Is there any way to download files stored on a yahoo group?

    [reply] [top]


      [»] Re: What about files
      by websissy - Nov 22nd 2004 10:28:57


      > Hi Is there any way to download files

      > stored on a yahoo group?

      >

      >
      If you found this tool of interest, then you might find this one helpful as well.

      http://freshmeat.net/projects/grabyahoogroup/

      It includes downloads for photos, files, member list, attachments and messages...

      Good Luck!
      WebSissy

      [reply] [top]




© Copyright 2008 SourceForge, Inc., All Rights Reserved.
About freshmeat.net •  Privacy Statement •  Terms of Use •  Trademark Guidelines •  Advertise •  Contact Us • 
ThinkGeek •  Slashdot  •  ITMJ •  Linux.com •  NewsForge  •  SourceForge.net  •  Surveys •  Jobs •  PriceGrabber