Skip to main content

Posts

Showing posts from 2018

Day 14 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Accessing y index https://stackoverflow.com/questions/522563/accessing-the-index-in-for-loops Ternary Operator https://stackoverflow.com/questions/394809/does-python-have-a-ternary-conditional-operator Python Dynamic Programming Language Focussed on Readibility Interpreted Language as vs Compiled Language Multiparadigm : Structure , object and Funtional oriented https://code.visualstudio.com/docs/python/tutorial-deploy-containers NLTK Download and punkt https://stackoverflow.com/questions/26570944/resource-utokenizers-punkt-english-pickle-not-found What are these pickle files C:\Users\rameezahmed.sayad\AppData\Roaming\nltk_data\tokenizers\punkt\PY3 Pickling and Unplicking ,pickle files https://www.pythoncentral.io/how-to-pickle-unpickle-tutorial/ Pandas Dataframe https://pandas.pydata.org/pandas-docs/stable/api.html Document Word Frequency and Inverse document Frequency Term Frequency or Word Frequency - is the frequency of a word in a document against tot...

Day 13 - Microsoft artificial Intelligence | Arduino Robotic Kit

Using Visual Studio for python -- back to debugging mode , feels amazing. So finally after managing to get 4 18650 batteries , 2 of them are discharged , now not sure how to recharge them. Good Resources for AI https://blog.goodaudience.com/learn-ai-for-free-5b186cde3990 Python Math Operators https://www.digitalocean.com/community/tutorials/how-to-do-math-in-python-3-with-operators Reading an Input form cmd line with python https://stackoverflow.com/questions/70797/user-input-and-command-line-arguments Convert string to int in Python https://guide.freecodecamp.org/python/how-to-convert-strings-into-integers-in-python/ https://www.programiz.com/python-programming/if-elif-else

Day 12 - Microsoft artificial Intelligence | Arduino Robotic Kit

Learning about electricity fundamentals. So we need 7v to 12v to power in battery mode. We got a 9v battery just to see if it works, but seems like the current might not be enough. https://www.teachmemicro.com/use-l298n-motor-driver/ http://forum.arduino.cc/index.php?topic=325357.0 https://forum.arduino.cc/index.php?topic=158582.0 https://arduino.stackexchange.com/questions/30595/lipo-batteries-with-l298n-controller https://www.robotshop.com/community/tutorials?mode=list&sort=newest&page=1 So it's final seems , the current provided by the 9v battery is quite less and needs more amps. https://learn.sparkfun.com/tutorials/how-to-power-a-project  https://www.open-electronics.org/the-power-of-arduino-this-unknown/ 18650 Battery https://www.makeuseof.com/tag/difference-32-bit-64-bit-windows/ Now back to Artificial Intelligence USING CURL to DOWNLOAD files http://www.compciv.org/recipes/cli/downloading-with-curl/ For opening Notebook https://azureml...

Day 11 Microsoft artificial Intelligence | Arduino Robotic Kit

Running motor using USB https://forum.arduino.cc/index.php?topic=464421.0 http://forum.arduino.cc/index.php?topic=210239.0 Voila , Motor, LED , Ultrasonic and Servo in action Only 1 motor can run from USB , both the motors cannot run simultaneously from USB voltage. 2 motors can be run or the 5v pins can be run at once.

Day 10 - Microsoft Artificial Intelligence | Arduino Robotic Kit

Excel Online https://onedrive.live.com/?id=E96BE125F9F308EB%21105&cid=E96BE125F9F308EB Try Except Python https://www.pythonforbeginners.com/error-handling/python-try-and-except https://docs.python.org/3/tutorial/errors.html Azure Notebooks https://notebooks.azure.com/sayadrameez/projects/azureml Urllib2 to urllib https://stackoverflow.com/questions/37042152/python-3-5-1-urllib-has-no-attribute-request Power Arduino using AC power Vin pin can also be used to power Arduino Servo Motor is for rotating using Arduino https://www.arduino.cc/en/Reference/Servo Arduino Shield is used to power and control motor. It has default pins which are used for sensing current and controlling the speed and direction of the motor.

Day 9 - Microsoft Artificial Intelligence | Arduino Robotic Kit

Motor Shield for Arduino motor shield is required for Bluetooth , GPS , GSM and Servo Motor in order to generate a stable and controlled current.  Connecting directly to Arduino board , the equipments may start drawing large current damaging the board. First Experiment with Arduino - LED Test. The RGB LED sensor has 4 points , 1 positive for 5 V connection and 1 each for red , green , blue . Pass accordingly LOW and HIGH to arduino Red , Green and Blue.

Day 8 - Microsoft AI | Arduino Robotic Kit

Arduino Robotic Kit https://photos.app.goo.gl/Ng6MmaRnxHHWUHpJ6 Just got my Arduino robotic kit , quite excited :-) , Let us start exploring the various components. HC SR 04 Ultrasonic Ranging Module https://www.mouser.com/ds/2/813/HCSR04-1022824.pdf HC - SR04 provides 2cm - 400cm non-contact measurement function, the ranging accuracy can reach to 3mm Vcc , Trigger , Echo n Ground  You only need to supply a short 10uS pulse to the trigger input to start the ranging, and then the module will send out an 8 cycle burst of ultrasound at 40 kHz and raise its echo. The Echo is a distance object that is pulse width and the range in proportion https://randomnerdtutorials.com/complete-guide-for-ultrasonic-sensor-hc-sr04/ https://www.arduino.cc/en/Reference/Libraries https://www.youtube.com/watch?v=6F1B_N6LuKw

Day 7 - Microsoft Professional Program for Artificial Intelligence track

2 class logistic regression https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/two-class-logistic-regression used to predict only 2 outcomes For  Label column , click  Launch column selector , and choose a single column that contains outcomes the model can use for training. For classification problems, the label column must contain either  categorical  values or  discrete  values. Some examples might be a yes/no rating, a disease classification code or name, or an income group. If you pick a noncategorical column, the module will return an error during training. For regression problems, the label column must contain  numeric  data that represents the response variable. Ideally the numeric data represents a continuous scale for creating web service , all steps need to be run

Day 6 - Microsoft Professional Program for Artificial Intelligence track

Scatter Plot Ready Module in AZMLS For removing an outlier , we can use sql transformation to update any row or values Why use matplotlib agg https://matplotlib.org/faq/howto_faq.html Setting utlier to threshhold , By using Clip Values , upper na dlower threshold can be set. https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/clip-values Convert to Indicator Values to add a column IsCategoricalValue 0 or 1 based on the no of values in the selected feature Supervised Learning Nearest neighbour, Naïve Bayes, Decision Trees, Regression  UnSupervised Learning K- means Clustering Algorithm ReInforcement Learning The machine/ software agent trains itself on a continual basis based on the environment it is exposed to, and applies it’s enriched knowledge to solve business problems.  Markov Decision Process “A computer program is said to learn from experience E with respect to some task T and some performance measure P, if its perfo...

Day 5 - Microsoft Professional Program for Artificial Intelligence track

PCA vs Mean - If probabilistic is used against a single column , it is equivalent to mean as it will used the single column. MICE - multiple imputation chained equations Normal Distribution - Bell Curve Seaborn https://seaborn.pydata.org/generated/seaborn.FacetGrid.html Indentation in Python http://www.peachpit.com/articles/article.aspx?p=1312792&seqNum=3 https://social.msdn.microsoft.com/Forums/azure/en-US/596f2988-49ff-4750-a00d-b24713543276/allow-seaborn-in-python-module?forum=MachineLearning Anaconda does not have Seaborn yet Normalizing Data - there are 5 technieques , even log , mainly because if there are large values in the data set which do not dominate the prediction Z SCORE https://t4tutorials.com/z-score-normalization-data-mining/ score using std  deviation MIN MAX https://t4tutorials.com/min-max-normalization-of-data-in-data-mining/ score between 0 and 1

Day 4 - Microsoft Professional Program for Artificial Intelligence track

Decision Tree Algorithm Assigning a label to the problem instance, Eg classifying gender so male or female become labels. Single Decision Tree single Decision Tree Ensemble Decision Tree multiple nodes Homogenous Sets- similar data or similar structure Heterogeneous Sets - mixed or unsimilar data Finding homogeneity - Information Gain Gini Impurity Beautiful Soup Python package for parsing HTML. Pandas Python package for reading HTML to dataframe , data analysis package. Panda Python package - categorical function for assigning integer to alphanumeric data. sklearn decision tree classifier Building own ML - Visual through ML Studio . Code first through Python notebooks. Consuming built in ML models - Azure cognitive services and bots

Day 3 - Microsoft Professional Program for Artificial Intelligence track

AI Cheat Sheet https://startupsventurecapital.com/essential-cheat-sheets-for-machine-learning-and-deep-learning-researchers-efb6a8ebd2e5 Jargons for ML Training Data - after raw data is processed Columns in Training Data is called Features Regression - Supervised Learning - line that best fits , least error Classification - Supervised Learning classify into classes Clustering - Unsupervised Learning create clusters Decision Tree Neural Network Bayesian Algorithm K-means Clustering Data Scientists can choose the features more appropriately who have the domain knowledge. Feature Engineering - includes cleaning , normalizing , rebalancing , grouping , filtering  raw data

Day 2 - Microsoft Professional Program for Artificial Intelligence track

Back to basics Learning Binary Search Tree and algorithms for Binary Tree https://leetcode.com/submissions/detail/193276741/ Big  O notation O(1) - exactly 1 computation to do the operation O(n) - computation time is equal to the size of array O(n square) - computation to nested for-each O(log (n)) - divide and conquer algorithms O(n log(n)) - Insertion Sort - iterate each element , check if it is lower than any of the element at the left and insert in between and move other elements greater than it. O(n square) , best O(n) - Bubble Sort - keep comparing side by side each element and swap O(n square) , best O(n) - if no swap at the first iteration Selection Sort - assume the first is smallest and find the smallest at first position, increment each position and check if anything is smaller. O(n square) , best O(n2) Heap Sort - elements are stored in binary tree. root node will be greater than child node.swap root and child , finally swap the last and first node...

Day 1 - Microsoft Professional Program for Artificial Intelligence track

Based on my friend's request , I have begun to write more on it. So it's been a long time since I have left Data Science in some lurk , but honestly I did struggle a lot to cope up with it. Plus because of timeframes , I scrambled through Data Science initial models , but I couldn't gather a lot except R programming and concepts of Data Science , ML and AI. Data Science seems a tough hill for me , by tough hill I mean way more time and effort , I got busy in work and then somehow , it's been pending , Suprisingly I didn't come across Microsoft Certification Program because that should be the defacto choice for a .Net Developer having spent more than 8 years professionally and 19 years with Microsoft and it's ecosystem. So I began seeing Microsoft Artifical Intelligence course it seems very exciting , although I remember my stint from GCP (Google Cloud Platform ) , it was a big thing doing some things I did very naturally with SQL or Excel. https://www....

Day 1 - Azure Learning - Docker

Docker Containers - switching https://docs.docker.com/docker-for-windows/#diagnose--feedback "docker pull" fails in windows 10 https://github.com/docker/for-win/issues/1100 [Windows] Cannot connect to plugin server -- wsarecv: An existing connection was forcibly closed by the remote host.  https://github.com/docker/machine/issues/2318 Disable Docker Support https://stackoverflow.com/questions/45843842/how-to-temporarily-disable-docker-support-from-asp-net-core-2-0-project-in-visua?rq=1 Remove Docker from Visual Studio project https://stackoverflow.com/questions/41642363/how-to-remove-docker-support-from-an-asp-net-core-project Turn Off Docker Support https://stackoverflow.com/questions/50182952/how-to-turn-docker-support-on-off-for-net-core-applications

Common Errors - NPM , Nodemon

Can't seem to get Node js and NPM up and running: Reference Error on every command https://stackoverflow.com/questions/37513487/cant-seem-to-get-node-js-and-npm-up-and-running-reference-error-on-every-comma 'npm' is not recognized as internal or external command, operable program or batch file https://stackoverflow.com/questions/20992723/npm-is-not-recognized-as-internal-or-external-command-operable-program-or-bat https://github.com/remy/nodemon#nodemon Node / Express: EADDRINUSE, Address already in use - Kill server https://stackoverflow.com/questions/4075287/node-express-eaddrinuse-address-already-in-use-kill-server

Visual Studio Node JS - Initial Setup

Let's keep it precise and small steps. 1. You need Visual Studio 2017 Community or Professional. 2. Select NodeJs development package. 3. You need NodeJs runtime to be installed from https://nodejs.org/en/download/ 4. Start a new project from VS 2017 , TypeScript->NodeJs 5. You might get an error , http or project not found. 6. Check the reference of the TypeScript project. 7. If you see the warning icon indicating that mode reference missing. 8. Right click and click Install from npm. 9. I you receive an error message , just follow the instructions. 10. Specify the node.exe path in the proj properties.C:\node-v8.9.4-win-x64\node.exe 11. Build and voila , let's start.