Interacting with Cloud
Storage
https://cloud.google.com/storage/docs/
We can upload data to cloud using gsutil or GCP
Console SSH
Google Cloud SDK
https://cloud.google.com/sdk/docs/
Open Data for UAE
http://opendata.fcsa.gov.ae/
https://cloud.google.com/sdk/docs/quickstart-windows
Transfer Services
Latency and Zones -
Distirubute the data across diff zones
4
Practical “less” Command Examples and tips for effective navigation in Linux:
http://www.sanfoundry.com/4-practical-less-command-examples-and-tips-effective-navigation-in-linux/
http://stackoverflow.com/questions/13805295/whats-a-sh-file
down vote |
What is a file with extension
.sh?
It is a Bourne shell script.
They are used in many variations of UNIX-like operating systems. They have no
"language" and are interpreted by your shell (interpreter of
terminal commands) or if the first line is in the form
#!/path/to/interpreter
they will use that particular interpreter.
Your file has the first line:
#!/bin/bash
|
bash ingest.sh
Step 6
Verify
that some data has been downloaded:
head earthquakes.csv
Code for the transformation of raw data to map in python
Then, run the transformation code:
python transform.py
Step 4
You will notice a new image file if
you list the contents of the directory:
ls -l
In the SSH window of the Compute Engine instance, type:
gsutil cp earthquakes.* gs:///
to
copy the files to Cloud Storage
Does deleting the instance
have any impact on the files that you stored on Cloud Storage? _
No deleting Compute Instance
has no impact on the Bucket
Emphasis of this exercise is
more onto how u could use R or python to transform ur data on the cloud and
store the results and use the Compute Engine for just the specific amount of
time.
Stopping the Compute Engine will not charge for the
computing , but will charge for the disk charges for the apps you have installed
like python and git related , the instance remains same.
Google Cloud Launcher
Learn R, in R.
swirl teaches you R programming and data science interactively,
at your own pace, and right in the R console!
Comments
Post a Comment