{"id":12462,"date":"2018-05-20T00:05:54","date_gmt":"2018-05-20T06:05:54","guid":{"rendered":"http:\/\/anthonyreinke.com\/?p=12462"},"modified":"2019-04-24T20:18:04","modified_gmt":"2019-04-25T02:18:04","slug":"speedcam","status":"publish","type":"post","link":"https:\/\/anthonyreinke.com\/index.php\/2018\/05\/20\/speedcam\/","title":{"rendered":"SpeedCam – Getting the Data"},"content":{"rendered":"

I recently got to be in be on the news for a fun project (see the bottom of the article for the video<\/a>).\u00a0 We have had issues with cars speeding down our street.\u00a0 I have had the traffic department place the street sign that showed your speed down the street.\u00a0 This did give us some data, but people seeing the signs changed their driving during that drive only.<\/p>\n

Being a person that works with data, I thought there has to be a way to track this data source.\u00a0 I tried to build my own system to track the cars going by.\u00a0 After trying a few different things, Arduino and Raspberry Pi, I started reading on using a webcams to track cars.<\/p>\n

My setup is as followed:
\nCamera: HIKVision IP Camera (but a USB camera will work also as shown in the news video<\/a>)
\nPower Injector: TP-LINK TL-PoE150S<\/a>
\nComputer: Dell Laptop running Windows 10
\nSpeed Camera Software: SpeedCam AI<\/a>
\nData Analyst Tool: Splunk<\/a><\/p>\n

I tried a few different programs and found SpeedCam AI.\u00a0 This program let me draw a rectangle and define the distance.\u00a0 I know that the sections of the street are 15 feet (4.572 meters) in length.<\/p>\n

\"\"<\/a> \"\"<\/a><\/center>I set up two different lanes.\u00a0 Lane 1 is for West bound traffic and Lane 2 is for East bound traffic.\u00a0 In the settings you can specify what the delimiter.\u00a0 You can also use the software to save a picture of the vehicle, and clean up the reports.<\/p>\n

\"\"<\/a><\/center>With SpeedCam AI writing the details of traffic to a csv file, Splunk can easily ingest the data.<\/p>\n

Installing Splunk on Windows<\/a>
\nInstalling Splunk on Linux<\/a><\/p>\n

Adding the data to Splunk:
\nOnce you log in to Splunk, you should see an “Add Data” button.
\n
\n<\/a>\"\"<\/a><\/p>\n

There is a couple options for bringing the data in.\u00a0 Select “Monitor” to be able to continuously bring in the data.
\n\"\"<\/a><\/p>\n

You will then want to select “Files & Directories”.
\n\"\"<\/a><\/p>\n

Click “Browse” to select your “reports.csv” file and then click “Next”.
\n\"\"<\/a><\/p>\n

You should see a preview of your data.\u00a0 You will see that Splunk has identified the data in a csv file.\u00a0 Since the file doesn’t have a header row, you will need to give it one.\u00a0 In the delimited settings, in the Field names section, click Custom.\u00a0 In this example I used “datestamp,lane,speed,speedLabel”.\u00a0 Then click next to continue.
\n\"\"<\/a><\/p>\n

It should prompt you to save your custom sourcetype.\u00a0 Click Save.
\n\"\"<\/a><\/p>\n

I gave the sourcetype name as “speedcam”.\u00a0 I then gave it a description and left the category and app the defaults and then click Save.
\n\"\"<\/a><\/p>\n

On the next page we can set the hostname for the data stream. Normally you can leave this the default. In a production environment, we would also want to choose our index. For this example, I am going to leave it as “Default”. At this point we can click “Review”.
\n\"\"<\/a><\/p>\n

You can review the setting and then click Submit and it will start bringing in your data.<\/p>\n

\n

For the Command Line People
\n## inputs.conf ##<\/strong>
\n[monitor:\/\/c:\\program files(86)\\SpeedCam\\reports\\reports.csv]
\nsourcetype = speedcam<\/em><\/span><\/p>\n

## props.conf ##<\/strong>
\n[speedcam]
\nINDEXED_EXTRACTIONS = CSV
\nFIELD_DELIMITER = ,
\nFIELD_NAMES = datestamp,lane,speed,speedLabel
\nCHECK_FOR_HEADER = false
\nSHOULD_LINEMERGE = false<\/em><\/span><\/p>\n

\n

At this point, you have the SpeedCam AI software running and Splunk bringing the data in.\u00a0 I will follow up with another post on the Splunk App I have written.\u00a0 In the mean time, here are a few videos on searching and reporting in Splunk.<\/p>\n

Basic Searching in Splunk<\/a>
\nCreating Reports in Splunk Enterprise<\/a>
\nCreate Dashboards in Splunk Enterprise<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

I recently got to be in be on the news for a fun project (see the bottom of the article for the video).\u00a0 We have had issues with cars speeding down our street.\u00a0 I have had the traffic department place the street sign that showed your speed down the street.\u00a0 This did give us some […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[30,23,29,26,28,5,22,24,27,25,15],"class_list":["post-12462","post","type-post","status-publish","format-standard","hentry","category-projects","tag-analyst","tag-cam","tag-data","tag-monitor","tag-neighborhood","tag-project","tag-speed","tag-speedcam","tag-splunk","tag-traffic","tag-windows"],"_links":{"self":[{"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/posts\/12462","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/comments?post=12462"}],"version-history":[{"count":9,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/posts\/12462\/revisions"}],"predecessor-version":[{"id":12639,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/posts\/12462\/revisions\/12639"}],"wp:attachment":[{"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/media?parent=12462"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/categories?post=12462"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/anthonyreinke.com\/index.php\/wp-json\/wp\/v2\/tags?post=12462"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}