Commit Graph
120 Commits
Author SHA1 Message Date
Karenzz a2fb3b29aa Task designed 2023-05-22 17:03:54 -04:00
Karenzz 88d17d979d Load the new price and timestamp 2023-05-22 17:03:25 -04:00
cheezedoodle2 3eb9bfb24e Added missing commas 2023-05-19 13:50:36 -07:00
j ea40df7f89 Update 'README.md' 2023-05-19 22:50:02 +02:00
j 8947238720 Add installation instructions 2023-05-19 21:52:16 +02:00
Karenzz 220adaf33a Created a new dataframe to store all keys data 2023-05-19 15:32:02 -04:00
Karenzz 80bc996230 Update 2023-05-19 15:31:34 -04:00
cheezedoodle2 09fdbb8b5d Move future.resuit() into the try block 2023-05-18 14:56:46 -07:00
cheezedoodle2 1ddc498430 Import the exception, too 2023-05-18 14:45:57 -07:00
cheezedoodle2 b8a4875e9d Wrapped the publish call to catch DeadlineExceeded exceptions 2023-05-18 14:45:18 -07:00
cheezedoodle2 24a1f04a2f Added package requirements and install instructions 2023-05-18 14:26:01 -07:00
Karenzz 99d2b60d5d Modified the main scraping loop 2023-05-18 15:01:04 -04:00
Karenzz 5bcc087f63 Run the scraper in parallel 2023-05-17 15:30:40 -04:00
Karenzz 7f13d0823b Used plotly to generate a graph 2023-05-17 15:01:04 -04:00
Karenzz 0e909fc3f9 Modified the sold out status checking 2023-05-17 15:00:37 -04:00
cheezedoodle2 92d7e745e1 Factored out element search logic, added scraping out-of-stock messages and sales figures 2023-05-16 15:55:20 -07:00
Karenzz b844189473 Recorded 11 products' price data 2023-05-16 16:44:53 -04:00
Karenzz 811a03b85c View the HDF5 file 2023-05-16 16:44:15 -04:00
Karenzz 27c44a1dfe Changed the product link 2023-05-16 16:43:43 -04:00
Karenzz 6c70c91161 Closed the modal dialog and saved data in HDF5 2023-05-16 16:42:15 -04:00
cheezedoodle2 722d116e75 Added checking for quantity discounts, re-enabled element debug to help troubleshoot dialog closing 2023-05-16 10:16:24 -07:00
cheezedoodle2 d88d231f24 Replaced some timeouts with WebDriverWait to speed up execution 2023-05-15 12:13:21 -07:00
Karenzz a925035acd Saved the df to a HDF5 file 2023-05-15 14:56:53 -04:00
Karenzz 2ead943e3a Cleaned up the exception and Added product_id 2023-05-11 12:50:33 -04:00
Karenzz dddf8e3bb8 Added minimum purchase exceptions 2023-05-11 12:49:13 -04:00
Karenzz 5983b79e1a Checked the availability of the product 2023-05-11 12:06:11 -04:00
Karenzz 7df52c95e1 Check the availability & time delay 2023-05-09 19:02:36 -04:00
Karenzz 8ed9dfbdf3 Check the availability & time delay 2023-05-09 19:01:46 -04:00
cheezedoodle2 528d134c65 Added workaround for j/python-bootcamp#3 by catching DeadlineExceeded and returning an empty message list 2023-05-08 18:29:49 -07:00
Karenzz bf32ca3cb8 Create a dataframe to store the zipcode & price 2023-05-08 18:57:47 -04:00
cheezedoodle2 ec7131c8e2 Changed subscriber to synchronous due to only having one browser window, fixed message acknowledgment. 2023-05-05 13:59:50 -07:00
Karenzz 4930f69a01 Merge branch 'Branch_Karen' of https://gogs.gtsplab.com:5432/j/python-bootcamp into Branch_Karen 2023-05-05 15:04:40 -04:00
Karenzz 19f6b0ff66 Added better xpath selectors for the UI elements 2023-05-05 15:01:15 -04:00
Karenzz 26aad47272 Added better xpath selectors for the UI elements 2023-05-05 15:00:11 -04:00
cheezedoodle2 c96a0b40ef Added better xpath selectors for the UI elements 2023-05-04 19:26:48 -07:00
Karenzz 8765abfb12 modified fp2_8 2023-05-04 19:19:11 -04:00
Karenzz 5a9e4a00d8 modified fp2_9 2023-05-04 19:18:52 -04:00
Karenzz ed955015fe modified fp2_9 2023-05-04 15:35:53 -04:00
Karenzz da65dd3317 zipcode csv files 2023-05-03 19:09:43 -04:00
Karenzz 6d88182baa update for the NFL zipcodes 2023-05-03 19:04:01 -04:00
Karenzz 7baaac206f fp2_4 update 2023-05-01 12:52:50 -04:00
Karenzz 72167507f9 modified fp2_4 & fp2_5 2023-04-28 19:30:00 -04:00
Karenzz d72087ac9f modified fp1 2023-04-27 19:17:28 -04:00
Karenzz 1cea8f5ff2 final project update 2023-04-26 19:14:54 -04:00
Karenzz 537b20f48d Merge branch 'Branch_Karen' of https://gogs.gtsplab.com:5432/j/python-bootcamp into Branch_Karen 2023-04-19 20:25:42 -04:00
Karenzz 9933b0b880 update 2023-04-19 20:24:03 -04:00
Karenzz 451ee7a557 for hw10 2023-04-19 20:22:09 -04:00
Karenzz abad8cc142 for hw10 2023-04-19 20:22:09 -04:00
Karenzz d5ee4388cb for hw10 2023-04-19 20:22:09 -04:00
Karenzz 8eb3a5ea06 for hw9 2023-04-19 20:22:09 -04:00