Skip to main content

Posts

Showing posts from January, 2019

Day 21 Microsoft AI Math | Arduino

So, instead of continuing in python programming course , I jumped on to Math for ML as that is more essential in terms of getting to it. I have been programming a while in python so it seems to be not an issue , although I need to keep up with all packages but since I keep doing the demo in the course hand typing myself , I start getting familiarized, this is a good point for lot of developers , instead of copy pasting or simp[ly uploading the Ipython notebook , start typing literally almost everything , the learning would be higher plus higher retaining, although the former will allow to finish faster but one may forget as he never encountered any issue while doing those , in my case I encounter so many setup issues that it helps retaining lot of things naturally. So in the same light and learning spirit , I want to dive into maths and understand something , quite eager. Distributive Property

Day 21 Microsoft AI Python | Arduino

So now I have begun my new course Python in the 10 series. https://stackoverflow.com/questions/16476924/how-to-iterate-over-rows-in-a-dataframe-in-pandas DataFrame Iterating Note  − Do not try to modify any object while iterating. Iterating is meant for reading and the iterator returns a copy of the original object (a view), thus the changes will not reflect on the original object. https://stackoverflow.com/questions/23330654/update-a-dataframe-in-pandas-while-iterating-row-by-row XML Etree Element Tree https://docs.python.org/3/library/xml.etree.elementtree.html One thing I realized how .Net had made the xml a piece of cake. Especially after Linq to Xml , we took most of things for granted , never did a xml fail a parse. In python I had to remove xml namespaces and then parse to get things working def removexmlnamespaces(xst):         it = ET.iterparse(StringIO(xst))     for index, el in it:         if '}' in el.tag:             el.tag = el.tag.split(

Day 20 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Data Science Virtual Machine Wow , seems a neat concept Seems I cannot change HDD to SDD once I create the VM https://buildwindows.wordpress.com/2015/10/11/azure-virtual-machine-resizing-consideration/ https://azure.microsoft.com/en-us/blog/resize-virtual-machines/ Cognitive ToolKit - Examples of Deep Learning in python https://tutorials-sayadrameez.notebooks.azure.com/j/lab I have just copy pasted below content from the App Developer Resources Cognitive Services For an overview of the Cognitive Services APIs, take a look at  Getting Started with Microsoft Cognitive Services  on Channel 9. Then you can dive into the documentation for individual Cognitive Services APIs, which often includes tutorials to help you get started (note that this is not an exhaustive list!): Linguistic Analysis Text Analytics Bing Speech Translator Language Understanding Intelligent Services (LUIS) Custom Vision Computer Vision Face Video Indexer Building Bots For in-depth trai

Day 19 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Finally I think Visual Studio has a fix for Anconda and Python envronments. It seems to recognise anaconda default environment and create more, also now I can see both packages pip and conda separately. It seems to make more sense as it lesser loaded . Installing av in python https://github.com/mikeboers/PyAV/issues/199 Git Clone Video Indexer API List Videos Find Video Basic Info by Video Id Upload Video Thumbanial View IPython Magic https://ipython.readthedocs.io/en/stable/interactive/magics.html VIdoe Indexer API allows to view thumbnail of key images you can embed video edit from video ai inline Moving to BOTS Need to deal with NodeJs as I have downloaded the bOTS API source code for NodeJs environment. gyp ERR! stack Error: Can't find Python executable "python", you can set the PYTHON env variable. Bot Framework emulator https://github.com/Microsoft/BotFramework-Emulator/releases/tag/v4.2.1 You can use the bot to embed as iframe in

Day 18 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Image Classifier Classify an image whether the tag matches I couldn't get it to work exactly. Azure Computer Vision API very interesting API , probably the most that I like so far of all, gives features about any picture and seemed fairly accurate. Most of the cognitive APIs body accepts json string instead of json data Face Detection APIs Can give certain attributes, match 2 faces Jupyter is formerly known as IPython so both are closely interchangeable https://code.visualstudio.com/docs/python/jupyter-support None of the interactive windows seem to work https://stackoverflow.com/questions/41664756/installing-numpy-for-windows-10-importing-the-multiarray-numpy-extension-module Failed to start the kernel XSRF cookie does not match POST argument OpenCV Python Library https://docs.opencv.org/3.4.0/d0/de3/tutorial_py_intro.html Finally got something working https://stackoverflow.com/questions/50185654/opencv-load-video-from-url for certain packages insta

Day 17 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Uninstall packages https://pip.pypa.io/en/stable/reference/pip_uninstall/ What is difference between cumulative distribution and normal distribution in histogram Gaussian Filter a 3 by 3 matrix is taken where in the center value is formed by average of beside values, this technique is moved across the whole image to reduce noise by averaging out all pixels sigma is the mask size Median Filter Edge Detection Algorithm Sobel Edge Detection Algorithm similar to filters , workd with a mask to find a gradient for x axis and y axis Harris Corner Algorithm Didn't work for median filtered image Custom VIsion AI Project https://customvision.ai/projects Selecting images and tagging them , train them https://customvision.ai/projects/1fe8cc76-7ace-4829-92e7-f25940e8f011#/predictions

Day 16 - Microsoft Artifical Intelligence | Arduino Robotic Kit

For anaconda packages , use Anaconda navigator which identifies correctly the missing dependencies. https://stackoverflow.com/questions/51992375/python-package-installation-issues-pyaudio-portaudio IPython doesn't work correctly need to move to jupyter_client https://github.com/Microsoft/PTVS/issues/3220 https://github.com/Microsoft/PTVS/issues/2722 Profiling in VIS for python https://docs.microsoft.com/en-us/visualstudio/python/profiling-python-code-in-visual-studio?view=vs-2017 Installing Package in Notebook https://stackoverflow.com/questions/38368318/installing- a-pip-package-from-within-a-jupyter-notebook-not-working https://stackoverflow.com/questions/7225900/how-to-install-packages-using-pip-according-to-the-requirements-txt-file-from-a?rq=1 Speech Translator Services and Language Understanding Intelligence Services LUIS https://www.luis.ai/applications/5eb952f8-d9ff-441d-8677-f1f655141569/versions/0.1/build/intents Web Chat BOT https://docs.microsof

Day 15 - Microsoft Artifical Intelligence | Arduino Robotic Kit

Azure ECOSystem https://docs.microsoft.com/en-us/azure/#pivot=get-started Azure Application Insights Just add a tag to client side to https://docs.microsoft.com/en-us/azure/application-insights/app-insights-dotnetcore-quick-start Feature Hashing https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/feature-hashing Giving a word or phrase an integer value indicating the relevance of that text in a given text or dataset. Created 32k column names , hence takes time to open the next dialog box Cannot apply SQL Transformation Need to use Select Columns Filter for publishing web service Sentimental Analysis Excel online https://onedrive.live.com/edit.aspx?resid=E96BE125F9F308EB%21116&nd=1&app=Excel Icon Sets- something new in excel as well Azure Cognitive Services for Text Analytics https://westus.dev.cognitive.microsoft.com/docs/services/TextAnalytics.V2.0/operations/56f30ceeeda5650db055a3c7 Error in urllib.request or conn.request