UnicodeEncodeError: 'ascii' codec can't encode character u'\ufffd' in position 12: ordinal not in range(128)

19 Jul 2013

The error in the title will occur on pre-0.12.0 versions of python’s Requests library. It seems to be fixed on later versions and maybe even earlier.

Here’s an example of how you save a zip file from behind a corporate proxy with python’s Requests library:

sess = requests.session() # you may have other get/post requests before you can get to the download page for the file url = 'https://example.com/report.zip' # this may be different for you, i just copied this from an existing request (using fiddler) file_headers = { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8', 'Accept-Language': 'en-US,en;q=0.8', 'User-Agent': 'Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0; Trident/5.0)', 'Host': 'example.com', 'Accept-Encoding': 'gzip,deflate,sdch', 'Connection': 'Keep-Alive', 'Content-Type': 'application/octet-stream;charset=text/html;charset=UTF-8', } with open('report.zip', mode='wb') as handle: report_file = sess.get(url, headers=file_headers, prefetch=False, verify=False) handle.write(report_file.content)

That’s it! Just use the write function with the content of the returned request.

requests.exceptions.SSLError: [Errno 1] _ssl.c:504: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed

19 Jul 2013 This happens with the Requests library in python. All you need to do is set verify=false.

For example:
cookieRequest = s.post(url, data=json.dumps(payload).strip('"'), allow_redirects=False, headers=headers, verify=False)

src/pycurl.c:42:20: fatal error: Python.h: No such file or directory

19 Jul 2013 The following helped to resolve this issue: sudo apt-get install python-dev

Writing To File - UnicodeEncodeError: 'ascii' codec can't encode characters

17 Jul 2013

I was getting a lot of errors when I was trying to download a file with the python requests library. The errors looked like the following:

UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 2-6: ordinal not in range(128)

This code ended up fixing it:

import codecs import requests import time # this could be different, but it works for my application, but the content-type definitely matters fileHeaders = { 'Content-Type': 'application/octet-stream;charset=text/html;charset=UTF-8' } url = 'www.yourfile.com/your.zip' with codecs.open('your.zip', mode='wb', encoding='utf-8') as handle: zip_file = requests.get(url, headers=fileHeaders, prefetch=False) for block in zip_file.iter_content(1024): if block: handle.write(block)

Prevent URL Encoding - Python Requests Library

15 Jul 2013
Use json.dumps in the data parameter.

for example:
r = s.post(url, data=json.dumps(payload), allow_redirects=False, cookies=cookieRequest.cookies)

Google Maps Event Firing Order

11 Jul 2013 http://gmaps-samples-v3.googlecode.com/svn/trunk/map_events/map_events.html

Tunnel Traffic Through Webserver Using Your Browser

10 Jul 2013

Use the following command in Cygwin (using your IP and Username, of course):

ssh yourUsername@198.168.xxx.xxx -D 2280 -i your/certificate

Set the following settings in Firefox (connect settings, under the advanced tab):

proxy settings

Dream Factory

10 Jul 2013 https://www.dreamfactory.com/

It's suspiciously free. It's a ready to go back-end that can be accessed with APIs.

Secure MySQL Command

03 Jul 2013 /usr/bin/mysql_secure_installation

Easyphp Change Directory To Github

02 Jul 2013 1. Right click on the easyphp icon --> configuration --> apache (this should open the httpd.conf in your easyphp apache directory)

2. Find the section labelled DocumentRootDirectory and overwrite with this:

# DocumentRootDirectory
<Directory "C:/Users/your_username/Documents/GitHub/your_project/">
#
# Possible values for the Options directive are "None", "All",
# or any combination of:
# Indexes Includes FollowSymLinks SymLinksifOwnerMatch ExecCGI MultiViews
#
# Note that "MultiViews" must be named *explicitly* --- "Options All"
# doesn't give it to you.
#
# The Options directive is both complicated and important. Please see
# http://httpd.apache.org/docs/2.4/mod/core.html#options
# for more information.
#
Options Indexes FollowSymLinks Includes ExecCGI

#
# AllowOverride controls what directives may be placed in .htaccess files.
# It can be "All", "None", or any combination of the keywords:
# Options FileInfo AuthConfig Limit
#
AllowOverride All

#
# Controls who can get stuff from this server.
#
Require all granted

</Directory>

Older Newer