PDA

View Full Version : Attention Watchdogs: new tool


mercinary
December 4th, 2003, 08:29 AM
I am a fairly well-versed PERL scripter, so I decided to write a PERL script for checking ebay auctions to see if the item has been removed yet (invalidated by ebay officials). The script is pretty basic, but it helped me figure out how many auctions that I reported had been closed.

HOW TO USE THE SCRIPT:
Only works on windows based machines. It is a command-line driven script.

You must have ActiveState PERL installed. Get that here: http://www.activestate.com

COMMAND LINE SYNTAX:
The script takes no arguements. Just double click the icon, which will spawn a command window, or open a command window and type "perl auction_check.pl".

The script will ask you for an input file. Give it the full path to the file: i.e. "c:\watchdogstuff\auctionlist.txt"

IMPORTANT! The input file you give it has to have a list of ebay auction numbers, with nothing else in the file. Each number must come on a seperate line. I.E:

3453124632
3462346235
3465326324



SAMPLE OUTPUT:
C:\>auction_check.pl


Enter a text file to input auction numbers from: c:\helper.txt

Opening file...

Processing Data...


3568757141 = alive
3570528896 = alive
3640121580 = alive
3640124060 = alive
3640125098 = alive
3640141016 = alive
3640145922 = alive
3062839424 = alive
2578100957 = dead
2578102397 = dead
2765727164 = alive
2766293982 = dead
2766585906 = dead
2766741546 = dead
2766753005 = dead
2767313304 = dead
2767451797 = dead
2767505694 = alive
2767516522 = dead
2767517007 = dead
2767723878 = alive
2767724843 = alive
2767728021 = alive
2767729251 = alive

There were a total of 24 auctions checked.

10 were found to be removed (invalid).

14 were found to be active.


Press any key to continue . . .




ENJOY!

-Merc

MatrixWatch
December 4th, 2003, 10:53 AM
This is fantastic. Is there a way that we could offer it in our downloads section?

What would be really cool now is if we could have a program to report auctions through that would be a little faster.

Perhaps we could have a box that people could paste the auction seller/numbers into and it would automatically send them off to eBay, and also help us keep a running database of seller/auction info, as well as whether or not they get shut down.

mercinary
December 4th, 2003, 11:10 AM
Watchdog,

I thought that would be nice also. I also thought about building a spider to crawl through ebay and pick out the offending auctions automatically.

Both of these aren't impossible, but would require quite a bit of work.

I already built another script similar to the one above, which checks on user ids rather than auctions themselves. It prints out which users are active, and which have been removed from ebay. I'm not 100% sure it works though, because I don't know what happens to a suspended users username on ebay.

Feel free to put this in the downloads section.

-Merc

MatrixWatch
December 4th, 2003, 11:22 AM
Looks like ycchen has a competitor for the December member of the month poll.

Great work Mercinary.

Now, do you own ActiveState.com?

mercinary
December 4th, 2003, 11:28 AM
oh, no no no no no. Activestate is a large company. I have no affiliation whatsoever.

Activestate just builds the freeware PERL that I write in.

-Merc

MatrixWatch
December 4th, 2003, 11:30 AM
Ah, I see.:)

Mercinary, if you have a minute, could you tell us how this software program works?

mercinary
December 4th, 2003, 11:37 AM
Are you referring to PERL?

PERL is a scripting language. Activestate builds the compiler and put all the librarys together. There are multiple brands of PERL compilers...activestate is just, in my opinion, vastly superior.

For more info about PERL itself, just search the web. There are millions of pages about every aspect of it.

Here is one of the many pages:

http://www.comp.leeds.ac.uk/Perl/start.html


-Merc

mercinary
December 5th, 2003, 03:15 PM
Attached is the second tool I wrote. Works in the exact same way, except you must supply an input file which has usernames listed (one name per line).

I ran it on my current list of sellers to show you what it does:

SAMPLE OUTPUT
Enter a text file to input auction usernames from: c:\user.txt

Opening file...

Processing Data...


10bestsell = alive
123andwin = alive
1976libra = alive
1sellers2004 = dead
ajmayers = alive
ama_smith = alive
angelscreams = alive
artie0515 = alive
axelious = alive
b8njw = alive
backwinded986 = dead
bagkingdom = alive
bazooka_tooth = alive
beamdreams3 = dead
beamergt = alive
ben910_1 = alive
bestdeels4u = alive
bigbeef50 = alive
bike_rider777 = alive
blaze_1981 = dead
bobb8813 = alive
bodykitconcept = alive
brainwash101 = alive
brianrehmann = alive
brysei = alive
btheemt = alive
buyvicow = dead
bztrends = dead
cavdon0312 = dead
cdpetri = dead
chialander = alive
chirob46 = alive
cigordon = alive
ciscosystemsinter = alive
crazy_leg = alive
cubsfan4254 = alive
cwspoon9jpz = alive
cybervex = alive
daniel2330 = alive
datacoman4184 = alive
deckmx1 = alive
dion249 = alive
djpaki69 = alive
dlo1206 = alive
dtank96 = alive
dustin-07 = alive
dylansdeals = alive
einvestww = dead
elitegraphics1 = dead
eproti = alive
evanderventer1 = dead
f00k3r = alive
fireman**rob** = alive
flyin_flounder = dead
freeballin325455 = alive
frodo2121 = alive
fwetar16 = dead
gameman4sale = dead
ghettopride1 = dead
ginesii = alive
good_deals_14 = alive
hardeez1 = alive
harryncrystal = alive
hotboymerlinlw = alive
hungryboyz = alive
i_got_cash = alive
im4itru = dead
infinium3 = alive
integra41 = dead
intrwwslz = dead
irishboyblu = alive
irrek0 = dead
isumpter = alive
jcarmine88 = dead
jesastarbear = alive
jhgf3 = dead
jhoove4 = alive
jimmynbrittney = alive
juanitamd = alive
justin1290 = alive
kangaroo3997 = dead
kangin8 = alive
kekoa64 = alive
kennyt2000 = alive
kgperkins = alive
killcrazy = alive
kkmilk = alive
krackedd2k = alive
kugar4esp = alive
kuruptedmind03 = dead
kushy2000 = alive
lilgdog7 = alive
liveranov2 = alive
michoben = alive
miss_sixty969 = dead
mkadrova = alive
mmorales004 = alive
mnmike13 = alive
naperville_dude = alive
newgigahert = dead
ninjai_17 = alive
nlevel9999 = dead
nlstathand = dead
nofx_punk21 = alive
nv_listman_2003 = dead
nvlston = dead
nwslsint = dead
oakland710 = alive
onlineauctionworks = alive
ontllc = alive
pammysongbird = alive
pasaload = alive
pexgiova = dead
pruimdo = dead
ps2lists = dead
pyro46t9 = alive
qqkltb = alive
queeniebee52 = dead
raist6 = alive
raywillp = alive
rcpowerzone = alive
riverratd = alive
riverratd = alive
rodneyswife = alive
rric92 = alive
rtravis316 = alive
sahriyah = alive
santonow = dead
shaknbakem1 = dead
sizzz1e = dead
snorfsnorf = alive
soccerstar1984 = alive
southert-selling = alive
stalebone77 = alive
steelhorse_999 = dead
stylintrucks = dead
sweet_lou23 = alive
symbolx-half = alive
syspal = dead
tayzak64 = alive
ten87510 = alive
thedietrichs9810 = alive
theschenks711 = alive
thinkofthis2007 = alive
timeless_momentsseller = alive
tkfman = alive
toycars6 = alive
tpsls_9898 = dead
troysnetwork = alive
trunkmonkey160 = alive
uniquities4u = alive
usukintershops = dead
valahzlz = dead
vazq503 = alive
vulturex@bellatlantic.net = alive
walkdogg_10 = alive
warlord099 = alive
white_neon = alive
wholesalevendor = alive
wizard0 = alive
wuzzle00 = alive
www_czechcc_com = alive
xboxes5 = dead
yuranyr09 = alive

There were a total of 164 usernames checked.

44 were found to be removed (invalid).

120 were found to be active.


Press any key to continue . . .


ENJOY!

-Merc

mercinary
December 5th, 2003, 07:20 PM
Attached is the first script that I wrote. I thought it was attached to the first message, but I guess not!!

-Merc

GODHCTAW
December 5th, 2003, 10:17 PM
Originally posted by mercinary
Attached is the first script that I wrote. I thought it was attached to the first message, but I guess not!!

-Merc

Hey Merc that is a leap forward.

Could I get t you to light up the dead in red so that they will stand out?

Or maybe extract them out to a seperate list so only those active remain to be worked with?

Let me know.

ycchen
December 5th, 2003, 10:18 PM
mercinary, this is so cooool! I will definitely try your cool software tool in one of these days! Thanks!

I bet we have many software experts on this forum, I wonder if other experts can somehow use and modify the tool that you wrote to make it even more user friendly?

Or we can have a competition on "PERL scripting"! Anyone who who write the best tool win the competition...:D

mercinary
December 5th, 2003, 11:41 PM
Yeah, definately a good idea. I could have made the thing much higher level with a better interface, but I like my scripts fast and simple.

The code is obviously open source, and very easy to understand if you know PERL, so I encourage anyone who is familiar with the language to take a whack at modifying them for their own needs.

I am also open to new ideas for a new PERL script that would help. I can do just about anything.

GODHCTAW: Like I said above, I can do anything you want. Just tell me exactly what would be helpful. I can parse out that bad names from the infput file, and store them in an output file if you like. I could also modify the script to output a formated html file with the results. Pretty much name it, and I can likely do it, or learn how. Let me know!

-Merc

mercinary
January 5th, 2004, 04:12 PM
Did anyone find use in these tools? I know there were a few inqueries, but beyond that I haven't heard much.

Let me know how it goes watchdogs!

-Merc

mercinary
March 6th, 2004, 09:03 AM
ycchen,

I built a second tool that reports on ebay user ids. You can find that tool on the 1st page of this thread. The tool takes a list of IDs and tells you if they are still valid ebay ids.

If this wasn't what you were looking for, I can certainly craft new tools to do different things. Just post specific details about: 1: What you would want to enter into the PERL script, 2: And what you would want to be outputted.

-Merc

ycchen
March 6th, 2004, 10:53 AM
got it! I thought there is only one file, in fact there are two files on the first page. One for auctions, the other for auction seller. Thanks.

mercinary
March 10th, 2004, 10:12 AM
OK...here is the granddaddy of them all...

a script that searches ebay for you, and creates lists of possible offending auctions in an easy form, so you can copy and paste into the ebay violation submittion form.

The script executes a number of searches on ebay, and compiles the resulting auction listings into a new html file, which opens up automatically when the script finishes.

NOTE: YOU HAVE TO DOUBLE CHECK ALL LINKS THAT THE SCRIPT OUTPUTS ARE VIOLATING AUCTIONS BEFORE SUBMITTING THEM TO EBAY!

This is because the script will return auctions that are not violating auctions.

Give it a try, tell me what you think. Additional searches can be added to the list of current searches very easily.

-Merc

mercinary
March 10th, 2004, 10:38 AM
DOH! I meant to do 10 in a row....guess my counter is off.

Attached is the updated script.

-Merc



SCRIPT ATTACHMENT MOVED TO A LATER POST.....

ycchen
March 10th, 2004, 10:50 AM
Merc, it will be cool if you can write a script to search for matrix-site auction SELLER ID! It is probably not possible.

I think if we can NARU (termininate) these matrix-site seller on eBay, it will be more effective than reporting the items. What do you think?

It is a shame that eBay do not do this screening themselves...:( If Merc can do that, I am 10000% sure that eBay can do the self-screening to clean out MOST of the illegal auctions. ...... no wonder why so many people are dissappointed with eBay ......:(

mercinary
March 10th, 2004, 11:11 AM
BAH! I never zipped up my changes. I just re-posted the old zip file. The new zip file contains te fix for 10 items per line, and the suggested change to track auctions already found.

-Merc

SCRIPT UPDATED, AND MOVED TO A LATER POST (AGAIN)...

mercinary
March 11th, 2004, 11:10 AM
Check it out...a new an improved version that I have been working on all morning. It it now smart enough to traverse multiple pages when there are more than 100 search results!!!

I also added another search to its list of searches. This one should pump out a ton more auctions.

Enjoy!

-Merc


FILE MOVED...AGAIN. SEE BELOW.

mercinary
March 11th, 2004, 12:28 PM
Out of complete bordem, I wrote a new script. This one takes an input file full of ebay usernames (one per line, no whitespaces) and then generates a webpage similar to the last script I wrote, except it gives the seller name, then lists the auctions (if any) that are being run by that seller.

ONCE AGAIN, NOTE THAT THIS DOESN'T MEAN THAT THOSE AUCTIONS ARE VIOLATIONS OF EBAY'S TERMS OF SERVICE.

Each and every auction must be checked by hand prior to reporting any auctions to ebay.

To run the script, make a file called "sellerslist.txt" filled with seller usernames (as described above). Then run the script in te same directory as thhat text file.

Enjoy!

-Merc

mercinary
March 11th, 2004, 04:27 PM
This is an updated version of the seller_search tool. spiderjohn found a problem with the script.

It ended up having to do with ebay's rediculously messy code and some unaccounted for newlines & returns....

Should be golden now.

Thanks spiderjohn!!!

-Merc

ycchen
March 11th, 2004, 08:04 PM
To run the script, make a file called "sellerslist.txt" filled with seller usernames (as described above). Then run the script in te same directory as thhat text file. I don't quite get the above instruction. I tried to run the 'golden' script, but it did not work. A return with a blank HTML.

mercinary
March 11th, 2004, 11:14 PM
Make a file that contains ebay usernames:

username1
username2
usernamex

Leave no whitespace before or after the usernames, and put one username per line. Save the file in the same directory as the seller_search.pl script. Save the text file as "sellerslist.txt".

Run the program.

-Merc

mercinary
March 12th, 2004, 09:19 AM
Another "smarter" version of the auction_search tool. Should remove from the results a good chunk of the auctions that are non-violaters. There are STILL auctions that are not violaters, so I ask you still check the auctions by hand by clicking the links. This could be time consuming, but nowhere near as bad as if you did the searches yourself.

I've run the script this morning and will be posting the results on another thread (after I have poured through all the results by hand).

Ycchen: Try this badboy out. It has some of your suggestions applied, as well as some other modifications I made.

-Merc

ycchen
March 12th, 2004, 11:19 AM
Great improvement! Good job! After all your creative and hardwork, I hope more new or old 'eBay Watchdogs" and volunteers can make good use of this tool to report the illegal eBay auctions.

Only when you report them, eBay authority will have NO EXCURSE but to do the final verification on all the reported items and hopefully cancel those auctions that are against their policy.

Keep up the great work! :)

mercinary
March 12th, 2004, 11:34 AM
http://www.matrixwatch.org/forums/showthread.php?s=&postid=10169#post10169

I ran the tool and posted the results at the above link (after going through each one of the auctions and removing non-offenders.

In total there were:

455 auctions printed out initially
56 non-offenders
2 auctions that had already been closed down by ebay

Not too bad considering it is just a script! : )

I'm also posting my copy of the database file that goes along with the auction_search.pl script. This way Ycchen, spiderjohn, or anyone else that wants to use the tool can avoid the listings which I already extracted with the tool. Just download the zip file, unzip the "database" file, and replace the existing "database" file in the directory where you are running the script.

-Merc

mercinary
March 12th, 2004, 12:09 PM
I was going to try slipping another version of the auction_search under everyone's radar, but it looks like at least a couple of people have already downloaded it.

So here is what I am doing:

In the post above that contains the auction_search.pl script, I'm just going to replace the old file with the new one.

I am going to do the same for the database file in the post above, as that has changed too.

confusing eh?

PM me with any questions.

-Merc

mercinary
April 9th, 2004, 10:10 AM
The auction search tool has been removed due to concerns that it will be used by matrix supporters to gear auction wording so that the script misses those auctions.

-Merc