#urllib

[ttacks]

Converting HTML to a Jupyter Notebook

In this post you will learn how to scrape code (from this site) to a Jupyter Notebook.

In this short post, we are going to learn how to turn the code from blog posts to Jupyter notebooks.

In this post, we are going to use the Python packages BeautifulSoup4, json, and urllib. We are going to use these packages to scrape the code from webpages putting their code within <code></code>.

(more…)

View On WordPress

[x-yuri]

vk auth

from urllib.parse import urlencode from urllib.request import urlopen from django.conf import settings import json redirect_uri = 'http://localhost:8000/t2' oauth_domain = 'oauth.vk.com' oauth_domain = 'vk-oauth-proxy.xtrafrancyz.net' api_domain = 'api.vk.com' api_domain = 'vk-api-proxy.xtrafrancyz.net' def t1(request): return redirect('http://{}/authorize?{}'.format('oauth.vk.com', urlencode({ 'client_id': settings.SOCIAL_AUTH_VK_OAUTH2_KEY, 'redirect_uri': redirect_uri, }))) def t2(request): url = 'https://{}/access_token?{}'.format(oauth_domain, urlencode({ 'client_id': settings.SOCIAL_AUTH_VK_OAUTH2_KEY, 'client_secret': settings.SOCIAL_AUTH_VK_OAUTH2_SECRET, 'redirect_uri': redirect_uri, 'code': request.GET['code'], })) r = urlopen(url) access_token = json.loads(r.read())['access_token'] url = 'https://{}/method/users.get?{}'.format(api_domain, urlencode({ 'v': '5.73', 'access_token': access_token, })) r = urlopen(url) return HttpResponse(r.read()) urlpatterns = [ url(r'^t1$', t1), url(r'^t2$', t2), ]

https://vk.com/dev/authcode_flow_user https://vk.com/dev/api_requests https://vk.com/dev/users.get https://xtrafrancyz.net/unblock-vk https://github.com/xtrafrancyz/vk-proxy

[howtorapeurjob]

how to download and unzip a file

Some of the resources are shared by zip file format. How can we download and unzip it? Is it possible unzip without download the file? You can use the method to archive the function.

save the file and unzip with the downloaded file

imoprt os import requests import shutil download_url = 'https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-freebsd-386.zip' file_name = urlparse(download_url).path.split('/')[-1] # dwonlaod file response = requests.get(url = download_url,stream=True) # start download handle = open(file_name, "wb") for chunk in response.iter_content(chunk_size=512): if chunk: # filter out keep-alive new chunks handle.write(chunk) # srart unzip shutil.unpack_archive(file_name,os.path.dirname(os.path.realpath(__file__)),format='zip')

unzip without download

from urllib.parse import urlparse from zipfile import ZipFile from urllib.request import urlopen download_url = 'https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-freebsd-386.zip' file_name = urlparse(download_url).path.split('/')[-1] # unzip file via stream with urlopen(download_url) as zipresp: with ZipFile(BytesIO(zipresp.read())) as zfile: zfile.extractall(os.path.dirname(os.path.realpath(__file__)))

[pacm3n-blog1]

Requests is an elegant and simple HTTP library for Python, built for human beings.

“Requests officially supports Python 2.6–2.7 & 3.3–3.6, and runs great on PyPy.” <-- and Up To Date 

[mebaghi272-blog]

(via https://www.youtube.com/watch?v=00Pu7__87oo)

[ahmetax]

Python ile web sitesinden başlıkları çekmek

Python ile web sitesinden başlıkları çekmek

Python ile web sitesinden başlıkları çekmek

İkinci dersimizde urllib ve re paketlerini kullanarak http://hurriyet.com.tr adresinden ana başlıkları nasıl indirebileceğimizi anlatıyorum. Bunlar, veri madenciliği ile ilgilenmeyi düşünen yeni python programcıları için yararlı olabilir.

Yaklaşık 10 satırlık bir kodlama ile gazetenin ana sayfasındaki tüm başlıkları kolayca indirebiliyoruz.

Ayrıca,…

View On WordPress

[goodanswerbiz]

Fixed Should I use urllib or urllib2 or requests? #dev #it #asnwer

Fixed Should I use urllib or urllib2 or requests? #dev #it #asnwer

Should I use urllib or urllib2 or requests?

In Python (2.5), should I use urllib or urllib2 or requests? What’s the difference? They seem to do the same thing.

Answer: Should I use urllib or urllib2 or requests?

urllib2.urlopen accepts an instance of the Request class or a url, whereas urllib.urlopen only accepts a url.

A similar discussion took place here: http://www.velocityreviews.com/forums…

View On WordPress

[goodanswerbiz]

Fixed How do I download a file over HTTP using Python? #dev #it #asnwer

Fixed How do I download a file over HTTP using Python? #dev #it #asnwer

How do I download a file over HTTP using Python?

I have a small utility that I use to download an MP3 from a website on a schedule and then builds/updates a podcast XML file which I’ve obviously added to iTunes.

The text processing that creates/updates the XML file is written in Python. I use wget inside a Windows .bat file to download the actual MP3 however. I would prefer to have the entire…

View On WordPress