![]() ![]() |
Home |
How it works |
Projects archive |
Contact Us Air Compressor Bot |
|
| The Career Path of Freelance Programming Jobs |
News Data Poller And Analyzer |
![]() |
Bidding Time: |
05/03/2005 22:32 - 12/03/2005 22:32 |
Budget: |
N/A |
Status: |
Closed |
|
|
|
Job Type: |
|
Description: |
To undertake this project you need to be comfortable with some basic mathematics, basic web interfaces, MYSQL, graphing capabilities and website polling and analysis. Understanding of query efficiency considerations are also important. The server runs Redhat and is a 1.3Ghz Celeron with 512Mb RAM. We would like to have a system developed which specifies and polls periodically a specific internet news site to determine the number of stories a particular set of news terms (such as "tsunami" or "prince charles") appears in. This data can then be queried and graphed from the web as required. Below are more detailed requirements . 1. Parameter and news term editor module An input editing screen to change news term and global parameters. a. a bulk input form for the list of news terms to be added b. the time between polls for these terms c. a term editor to change the polling times or deactivate polling for a specific term term d. a term deleter which deletes the term and its polling history from the database e. a parameter for specifying how long to wait before trying to poll the news term again if the previous poll failed (due to downtime etc) f. a parameter to specify the minimum allowable time between polls of the news site. 2. Polling module In the background, news terms will be polled according to the individual specified in the news term editor, the data time-stamped and stored in the database (along with any associated data that makes the ranking module queries more efficient). This needs to be able to restart sensibly if the host running this system experiences downtime. 3. Graphing module Allows the selection of any set of news terms and any time period and will create a simple line graph showing the number of occurrences of each term over the chosen time period. This module can also be fed input by the ranking module. 4. Ranking module Allows the specification of a "From" time range and a "To" time range and determines which news terms have experienced the greatest increases and/or decreases in occurrences from the "To" time range over the "From" time range. Because the polling periods of each term differs, this requires some basic mathematics. This is calculated as the area under the line graph connecting each data point. See the diagram here http://www.zaebiz.net/news/area1.jpg. Now when the time range (xa,xb) does not match up with the polling times of the term, the area under the line graph (as marked by the grey shading) must be calculated using interpolated data points ya, yb according to this diagram http://www.zaebiz.net/news/area2.jpg. A parameter to specify a minimum number of results the term must have in the last polling period before it is considered in the analysis can also be specified. After the results are presented, the individual terms can be selected and graphed by the Graphing module. A system which has some commonality with this project can be seen here http://mediamammon.drunkmenworkhere.org. But please do NOT be confused by this. Our system will NOT be a bidding and purchase system like that one is, and will contain enhanced graphing, ranking and editing functionality that this one lacks. If you are in doubt, please ask any questions before bidding. It is important that we believe you understand what is required before accepting your bid so don't feel pressured to get a bid in before you understand the requirements. The most important criteria in selecting a bidder will be demonstration of skills in this area as well as cost. Time to implement is not very important. Note also that future add-ons to this project may be required (and paid for separately of course) so a good design is essential. Escrow is available. Someone will usually be available to discuss requirements almost every day for at least several hours. Additional Info (Added 3/5/2005 at 22:38 EST)... Also feel free to suggest an alternative implementation language This project is the proprietary information of .
Click here to remove this project from OUR database.
|
Operating System: |
Linux |
Database System: |
MySQL |
| <<< back |
|
| Home | Projects archive | RSS | Resources | Links | Contact Us | © 2004-2008 ProjectsList.biz /3.459 |