gevent.local.local
objects that have no value in the greenlet. See issue #1275.gevent.local.local
subclasses correctly supports
@staticmethod
functions. Reported by Brendan Powers in
issue #1266.close_fds
argument on 3.7.gevent.queue
imports _PySimpleQueue
instead of
SimpleQueue
so that it doesn’t block the event loop.
gevent.monkey.patch_all()
makes this same substitution in
queue
. This fixes issues with
concurrent.futures.ThreadPoolExecutor
as well. Reported in
issue #1248 by wwqgtxx and issue #1251 by pyld.gevent.socket.socket.connect()
doesn’t pass the port (service)
to socket.getaddrinfo()
when it resolves an AF_INET
or
AF_INET6
address. (The standard library doesn’t either.) This
fixes an issue on Solaris. Reported in issue #1252 by wiggin15.gevent.socket.socket.connect()
works with more address
families, notably AF_TIPC, AF_NETLINK, AF_BLUETOOTH, AF_ALG and AF_VSOCK.MonkeyPatchWarning
for ssl
imports. Now, we only issue it if we detect the one specific
condition that is known to lead to RecursionError. This may produce
false negatives, but should reduce or eliminate false positives.gevent.pywsgi
generates HTTP chunks. This is intended to
reduce network overhead, especially for smaller chunk sizes.gevent.pywsgi
.
See pull request #1241.gevent.sleep()
updates the loop’s notion of the current time
before sleeping so that sleep duration corresponds more closely to
elapsed (wall clock) time. gevent.Timeout
does the same.
Reported by champax and FoP in issue #1227.UnboundLocalError
in SSL servers when wrapping a socket
throws an error. Reported in issue #1236 by kochelmonster.gevent.queue.Queue
. Reported in
issue #1217 by githrdw.gevent.event.Event
. Reported in
issue #1211 by Matias Guijarro.gevent.Greenlet.spawn()
, especially under
uwsgi. Reported in issue #1212 by Kunal Gangakhedkar.gevent.os.nb_write()
and gevent.os.nb_read()
not
always closing the IO event they opened in the event of an
exception. This would be a problem especially for libuv.gevent.local.local
subclasses that mix-in ABCs can be instantiated.
Reported in issue #1201 by Bob Jordan.gevent.subprocess.Popen
uses /proc/self/fd
(on Linux) or
/dev/fd
(on BSD, including macOS) to find the file descriptors
to close when close_fds
is true. This matches an optimization
added to Python 3 (and backports it to Python 2.7), making process
spawning up to 9 times faster. Also, on Python 3, since Python 3.3
is no longer supported, we can also optimize the case where
close_fds
is false (not the default), making process spawning up
to 38 times faster. Initially reported in issue #1172 by Ofer Koren.gevent.wsgi
was removed.gevent.util.assert_switches
to build on the monitoring
functions. Fixes issue #1182.threading.Event
, also
monkey-patch the underlying class, threading._Event
. Some code
may be type-checking for that. See issue #1136.name
attribute in
their repr.map
. See pull request #1153.IMap
and
IMapUnordered
classes are now compiled with Cython, further
reducing the overhead of [Thread]Pool.imap
.gevent.event.Event
and gevent.event.AsyncResult
are compiled with Cython for improved performance, as is the
gevent.queue
module and gevent.hub.Waiter
and certain
time-sensitive parts of the hub itself. Please report any
compatibility issues.python -m gevent.monkey <script>
accepts more values for
<script>
, including paths to packages or compiled bytecode.
Reported in issue #1157 by Eddie Linder.zope.event
if that is installed.gevent.monkey
has support for plugins in the form of event
subscribers and setuptools entry points. See pull request #1158 and
issue #1162. setuptools must be installed at runtime for its entry
points to function.gevent.config.track_greenlet_tree
(aka
GEVENT_TRACK_GREENLET_TREE
) to allow disabling the greenlet tree
features for applications where greenlet spawning is performance
critical. This restores spawning performance to 1.2 levels.GEVENT_MONITOR_THREAD_ENABLE
to
use it, and GEVENT_MAX_BLOCKING_TIME
to configure the blocking
interval.psutil
must be installed to use this. See pull request #1150.dnspython
resolver as a lightweight alternative to
c-ares. It is generally faster than c-ares and is supported on PyPy.
c-ares may be deprecated in the future. See pull request #1088 and
issue #1103.gevent.time
that can be imported instead of
time
, much like gevent.socket
can be imported instead
of socket
. It contains gevent.sleep
. This aids
monkey-patching.gevent.local.local
now have the same
(substantially improved) performance characteristics of plain
gevent.local.local
itself, making them 2 to 3 times faster than
before. See pull request #1117. If there are any compatibility
problems, please open issues.minimal_ident
property. It functions
similarly to Thread.ident
or id
by uniquely identifying the
greenlet object while it remains alive, and it can be reused after
the greenlet object is dead. It is different in that it is small and
sequential. Based on a proposal from PayPal and comments by Mahmoud
Hashemi and Kurt Rose. See issue #755. As always, feedback is
appreciated.gevent.Greenlet
objects now have a gevent.Greenlet.name
attribute that is included in the default repr.gevent.local.local
objects associated with
each greenlet in gevent.util.format_run_info
.gevent.util.GreenletTree
to visualize the greenlet tree. This
is used by gevent.util.format_run_info
.gevnt.subprocess.Popen
accept the restore_signals
keyword argument on all versions of Python, and on Python 2 have it
default to false. It previously defaulted to true on all versions;
now it only defaults to true on Python 3. The standard library in
Python 2 does not have this argument and its behaviour with regards
to signals is undocumented, but there is code known to rely on
signals not being restored under Python 2. Initial report and patch
in pull request #1063 by Florian Margaine.gevent.subprocess.Popen
to accept the keyword
arguments pass_fds
and start_new_session
under Python 2.
They have always had the same default as Python 3, namely an empty
tuple and false, but now are accessible to Python 2.capture_output
argument added to Python 3.7 in
gevent.subprocess.run()
.gevent.config
, allowing for gevent to be configured through code
and not necessarily environment variables, and also provide a
centralized place for documentation. See issue #1090.GEVENT_CORE_CFFI_ONLY
environment variable has been
replaced with the pre-existing GEVENT_LOOP
environment
variable. That variable may take the values libev-cext
,
libev-cffi
, or libuv-cffi
, (or be a list in preference
order, or be a dotted name; it may also be assigned to an
object in Python code at gevent.config.loop
).GEVENTARES_SERVERS
environment variable is deprecated in
favor of GEVENT_RESOLVER_SERVERS
. See issue #1103.shutdown
on a closed socket. It was raising
AttributeError
, now it once again raises the correct
socket.error
. Reported in issue #1089 by André Cimander.loop
objects referenced the default event loop and one of them was
destroyed and then the other one destroyed or (in the libev C
extension implementation only) deallocated (garbage collected). See
issue #1098.gevent._threading
has been
simplified.gevent._socket3._fileobject
has
been removed. See issue #1084.destroy()
method. The default loop, when destroyed, can again be requested and
it will regenerate itself. The default loop is the only one that can
receive child events.gevent.socket.socket.sendall()
up to ten times faster on
PyPy3, through the same change that was applied in gevent 1.1b3 for PyPy2.gevent.greenlet
module is now compiled with Cython to
offset any performance decrease due to issue #755. Please open
issues for any compatibility concerns. See pull request #1115 and pull request #1120.gevent.Greenlet
, gevent.local
and gevent.lock
to be
used when the environment variable PURE_PYTHON
is set. This is
not recommended except for debugging and testing. See issue #1118.gevent.select.poll.poll()
now interprets a timeout of -1 the
same as a timeout of None as the standard requires. Previously,
on libuv this was interpreted the same as a timeout of 0. In
addition, all timeout values less than zero are interpreted like
None (as they always were under libev). See issue #1127.threading.Event
.async
functions and classes have been renamed to
async_
due to async
becoming a keyword in Python 3.7.
Aliases are still in place for older versions. See issue #1047.gevent.subprocess
will have a
filename
attribute set.threading.Timer
class is now monkey-patched and can
be joined. Previously on Python 3.4 and above, joining a Timer
would hang the process.gevent.ssl.SSLSocket.unwrap()
behaves more like the standard
library, including returning a SSLSocket and allowing certain
timeout-related SSL errors to propagate. The added standard
library tests test_ftplib.py
now passes.gevent.subprocess.Popen
accepts a “path-like object” for
the cwd parameter on all platforms. Previously this only worked
on POSIX platforms under Python 3.6. Now it also works on Windows under
Python 3.6 (as expected) and is backported to all previous versions.make
is no longer required and the
Makefile
is not used. Neither is an external cython
command.
Instead, the cythonize
function is used, as recommended by
Cython. (The external commands were never required by source
distributions.) See issue #1076.gevent.local.local
is compiled with Cython on CPython.gevent.local.local
objects without ever exiting, there
would be a leak of the function objects intended to clean up the
locals after the greenlet exited. Introduce a weak reference to
avoid that. Reported in issue #981 by Heungsub Lee.errno.WSAECONNABORTED
on Windows. Initial patch in
pull request #999 by Jan van Valburg.gevent.subprocess.Popen.communicate()
returns the correct type
of str (not bytes) in universal newline mode under Python 3, or when
an encoding has been specified. Initial patch in pull request #939 by
William Grzybowski.gevent.subprocess.Popen.communicate()
(and in general,
accessing Popen.stdout
and Popen.stderr
) returns the correct
type of str (bytes) in universal newline mode under Python 2.
Previously it always returned unicode strings. Reported in
issue #1039 by Michal Petrucha.gevent.fileobject.FileObjectPosix
returns native strings in
universal newline mode on Python 2. This is consistent with what
FileObjectThread
does. See issue #1039.socket.send()
now catches EPROTOTYPE
on macOS to handle a race
condition during shutdown. Fixed in pull request #1035 by Jay Oster.gevent.socket.create_connection()
now properly cleans up open
sockets if connecting or binding raises a BaseException
like
KeyboardInterrupt
, greenlet.GreenletExit
or
gevent.timeout.Timeout
. Reported in issue #1044 by
kochelmonster.Pool.add
now accepts blocking
and timeout
parameters,
which function similarly to their counterparts in Semaphore
.
See pull request #1032 by Ron Rothman.
Defer adjusting the stdlib’s list of active threads until
threading
is monkey patched. Previously this was done when
gevent.threading
was imported. That module is documented to
be used as a helper for monkey patching, so this should generally
function the same, but some applications ignore the documentation
and directly import that module anyway.
A positive consequence is that import gevent.threading, threading;
threading.current_thread()
will no longer return a DummyThread
before monkey-patching. Another positive consequence is that PyPy
will no longer print a KeyError
on exit if
gevent.threading
was imported without monkey-patching.
See issue #984.
Specify the Requires-Python metadata for improved installation support in certain tools (setuptools v24.2.1 or newer is required). See issue #995.
Monkey-patching after the ssl
module has been imported now
prints a warning because this can produce RecursionError
.
gevent.local.local
objects are now approximately 3.5 times faster
getting, setting and deleting attributes on PyPy. This involved
implementing more of the attribute protocols directly. Please open
an issue if you have any compatibility problems. See issue #1020.
gevent.local.local
is compiled with Cython on CPython. It
was already 5 to 6 times faster due to the work on issue #1020,
and compiling it with Cython makes it another 5 to 6 times faster,
for a total speed up of about 35 times. It is now in the same
ballpark as the native threading.local
class. It also uses
one pointer less memory per object, and one pointer less memory per
greenlet. See pull request #1024.
More safely terminate subprocesses on Windows with
gevent.subprocess.Popen.terminate()
. Reported in issue #1023
by Giacomo Debidda.
gevent now uses cffi’s “extern ‘Python’” callbacks. These should be faster and more stable. This requires at least cffi 1.4.0. See issue #1049.
gevent now approximately tries to stick to a scheduling interval
when running callbacks, instead of simply running a count of
callbacks. The interval is determined by
gevent.getswitchinterval()
. On Python 3, this is the same as
the thread switch interval. On Python 2, this defaults to 0.005s and
can be changed with gevent.setswitchinterval()
. This should
result in more fair “scheduling” of greenlets, especially when
gevent.sleep(0)
or other busy callbacks are in use. The interval
is checked every 50 callbacks to keep overhead low. See
issue #1072. With thanks to Arcadiy Ivanov and Antonio Cuni.
Add initial experimental support for using libuv as a backend
instead of libev, controlled by setting the environment variable
GEVENT_CORE_CFFI_ONLY=libuv
before importing gevent. This
suffers a number of limitations compared to libev, notably:
--no-binary
option).gevent.sleep
and gevent.Timeout
) only
support a resolution of 1ms (in practice, it’s closer to 1.5ms).
Attempting to use something smaller will automatically increase it
to 1ms and issue a warning. Because libuv only supports
millisecond resolution by rounding a higher-precision clock to an
integer number of milliseconds, timers apparently suffer from more
jitter.poll
call is
that amount. Note that this is what gevent does for libev on
Windows too.gevent.select.poll
or a monkey-patched
selectors.PollSelector
.abort()
the
entire process instead of reporting an error. For example, closing
a file descriptor it is using in a watcher may cause the entire
process to be exited.asyncore
; see test_ftplib.py
) and
sometimes sockets not getting closed in a timely fashion
(apparently; see test_httpservers.py
) and communicating with
subprocesses (it always hangs). Help tracking those down would be
appreciated. Only PyPy2 is tested.Feedback and pull requests are welcome, especially to address the issues mentioned above.
Other differences include:
The order in which timers and other callbacks are invoked may be different than in libev. In particular, timers and IO callbacks happen in a different order, and timers may easily be off by up to half of the supposed 1ms resolution. See issue #1057.
Starting a timer
watcher does not update the loop’s time by
default. This is because, unlike libev, a timer callback can cause
other timer callbacks to be run if they expire because the loop’s
time updated, without cycling the event loop. See issue #1057.
libev has also been changed to follow this behaviour.
Also see issue #1072.
Timers of zero duration do not necessarily cause the event loop to cycle, as they do in libev. Instead, they may be called immediately. If zero duration timers are added from other zero duration timer callbacks, this can lead the loop to appear to hang, as no IO will actually be done.
To mitigate this issue, loop.timer()
detects attempts to use
zero duration timers and turns them into a check watcher. check
watchers do not support the again
method.
All watchers (e.g., loop.io
) and the Timeout
class have a
close
method that should be called when code is done using the
object (they also function as context managers and a with
statement will automatically close them). gevent does this
internally for sockets, file objects and internal timeouts.
Neglecting to close an object may result in leaking native
resources. To debug this, set the environment variables
GEVENT_DEBUG=debug
and PYTHONTRACEMALLOC=n
before starting
the process.
The traditional cython-based libev backend will not leak if
close
is not called and will not produce warnings. The
CFFI-based libev backend will not currently leak but will produce
warnings. The CFFI-based libuv backend may leak and will produce
warnings.
Again, this is extremely experimental and all of it is subject to change.
See issue #790 for history and more in-depth discussion.
AttributeError
or have a negative value when not available. In
general these attributes are not portable or documented and are
not implemented by libuv or the CFFI backend. See issue #1076.gevent_handle_error
, and part of
gevent_call
) are now implemented in Cython instead of C. This
reduces our reliance on internal undocumented implementation
details of Cython and Python that could change. See pull request #1080.Next page: Changes for gevent 1.2