hak8or/greasemonkey_scripts
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Moved ebay scraping into separate directory and added rust version

Browse Source 
```
➜ time yarn --silent scrape --only_json --load foo4.html > /dev/null

________________________________________________________
Executed in  742.13 millis    fish           external
   usr time  605.32 millis  408.00 micros  604.91 millis
   sys time  229.09 millis  214.00 micros  228.88 millis
```

```
➜ time cargo run --release -- --only-json --load foo4.html > /dev/null
    Finished `release` profile [optimized] target(s) in 0.06s
     Running `target/release/ebay_scraper_rust --only-json --load foo4.html`

________________________________________________________
Executed in  122.54 millis    fish           external
   usr time   87.85 millis  597.00 micros   87.26 millis
   sys time   40.10 millis  152.00 micros   39.95 millis
```
This commit is contained in:
hak8or
2025-05-29 00:29:53 -04:00
parent 89bd668a9c
commit a3ca94e200
12 changed files with 2806 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
ebay_storage/rust/Cargo.toml Normal file
View File

@ -0,0 +1,19 @@
[package]
name = "ebay_scraper_rust"
version = "0.1.0"
edition = "2021"
[dependencies]
clap = { version = "4.4", features = ["derive"] }
reqwest = { version = "0.11", features = ["json", "stream"] } # Removed "blocking" as we use tokio
scraper = "0.18"
serde = { version = "1.0", features = ["derive"] }
serde_json = "1.0"
regex = "1.10"
tokio = { version = "1", features = ["full"] }
url = "2.5"
# path-slash is not strictly needed if using std::path::PathBuf correctly
bytes = "1.5"
chrono = { version = "0.4", features = ["serde"] }
lazy_static = "1.4.0"
futures = "0.3" # For join_all on async tasks