Internet Access with Python Tutorial: Open, Parse & Read URL

-
With Python you can also access and retrieve data from the internet like XML, HTML, JSON, etc. You can also use Python to work with this data directly. In this tutorial we are going to see how we can retrieve data from the web. For example, here we used a guru99 video URL, and we are going to access this video URL using Python as well as print HTML file of this URL. 





In this tutorial we will learn

How to connect to Internet data

Before we run the code to connect to Internet data, we need to import statement for URL library two module or "urllib2". It is a Python module that provides utilities for connecting to web addresses and retrieving data from them.
Internet Access with Python Tutorial: Open, Parse & Read URL
  • Import urllib2
  • Define your main function
  • Declare the variable webUrl
  • Then call the urlopen function on the URL lib two library
  • The URL we are opening is guru99 tutorial on youtube
  • Next, we going to print the result code
  • Result code is retrieved by calling the getcode function on the webUrl variable we have created
  • We going to convert that to a string, so that it can be concatenated with our string "result code"
  • This will be a regular HTTP code "200", indicating http request is processed successfully

How to read HTML file for your URL in Python

You can also read the HTML file by using the "read function" in Python, and when you run the code, the HTML file will appear in the console.
Internet Access with Python Tutorial: Open, Parse & Read URL
  • Call the read function on the webURL variable
  • Read variable allows to read the contents of data files
  • Read the entire content of the URL into a variable called data
  • Run the code- It will print the data into HTML format
Here is the complete code
#  
# read the data from the URL and print it
#
import urllib2

def main():
# open a connection to a URL using urllib2
   webUrl = urllib2.urlopen("https://www.youtube.com/user/guru99com")
  
#get the result code and print it
   print "result code: " + str(webUrl.getcode()) 
  
# read the data from the URL and print it
   data = webUrl.read()
   print data
 
if name == "__main__":
  main()

Comments

Post a Comment

Popular posts from this blog

Introduction to BIG DATA: Types, Characteristics & Benefits

-
Image
In order to understand 'Big Data', we first need to know what  'data'  is. Oxford dictionary defines  'data'  as - "The quantities, characters, or symbols on which operations are performed by a computer, which may be stored and transmitted in the form of electrical signals and recorded on magnetic, optical, or mechanical recording media. " In this tutorial we will learn, Examples Of 'Big Data' Categories Of 'Big Data' Characteristics Of 'Big Data' Advantages Of Big Data Processing So, 'Big Data' is also a  data  but with a  huge size . 'Big Data' is a term used to describe collection of data that is huge in size and yet growing exponentially with time.In short,  s uch a data is so large and complex that none of the traditional data management tools are able to store it or process it efficiently. Examples Of 'Big Data' Following are some the examples of 'Big Data'-
Read more

Learn Python Main Function with Examples: Understand __main__

-
Image
Before we jump more into Python coding, we get familiarize with Python Main function and its importance. Consider the following code def main() print "hello world!" print "Guru99" Here we got two pieces of print one is defined within a main function that is "Hello World" and the other is independent which is "Guru99". When you run the function def main ():  Only "Guru99" prints out and not the code "Hello World." It is because we did not declare the call  function "if__name__== "__main__". When Python interpreter reads a source file, it will execute all the code found in it. When Python runs the "source file" as the main program, it sets the special variable (__name__) to have a value ("__main__"). When you execute the main function, it will then read the "if" statement and checks whether __name__ does equal to __main__. In Python  "if__name__== "__
Read more

Python XML Parser Tutorial: Create & Read XML with Examples

-
Image
Python enables you to parse and modify XML document. In order to parse XML document you need to have the entire XML document in memory. In this tutorial, we will see how we can use XML minidom class in Python to load and parse XML file.  In this tutorial, we will learn- How to Parse XML How to Create XML Node How to Parse XML We have created a sample XML file that we are going to parse. Step 1)  Inside file, we can see first name, last name, home and the area of expertise (SQL, Python, Testing and Business) Step 2 : Once we have parsed the document, we will print out the  "node name"  of the root of the document and the " firstchild tagname" . Tagname and nodename are the standard properties of the XML file. Import the xml.dom.minidom module and declare file that has to be parsed (myxml.xml) This file carries some basic information about employee like first name, last name, home, expertise, etc. We use the parse function on the XML minido
Read more