d0660a9a40
gh-101410: Customize error messages for 1-arg math functions ( #129497 )
...
This also reverts loghelper() change in 75f59bb629
2025-04-22 11:29:20 +02:00
8dfa840773
gh-127604: Add C stack dumps to `faulthandler` ( #128159 )
2025-04-21 20:48:02 +01:00
78cfee6f09
gh-132753: Argument Clinic: Fix support of c_default for the bool converter (GH-132754)
2025-04-20 23:21:29 +00:00
5f2ba152a0
gh-131298: eliminate HACL* static libraries for cryptographic modules (GH-132438)
...
* simplify HACL* build for MD5, SHA1, SHA2 and SHA3 modules
* remove statically linked libraries for HACL* implementation
* is it better now?
* is it better now?
* fixup
* Present HACL* as a static or shared library.
On WASI, extension modules based on HACL* require the HACL*
library to be linked statically. On other platforms, it can
be built dynamically.
* amend whitespace
* remove temporary .so file as it requires more symlinks
* avoid smelly symbols
* fixup checksums
* regen sbom
* fixup shell warnings and comments
* it *should* work
2025-04-20 17:40:17 +00:00
5b06d2ceca
gh-127945: add lock held assertions in ctypes arrays ( #132720 )
2025-04-19 18:27:10 +05:30
9752c84022
gh-89562: Remove hostflags from PySSLContext (GH-28602)
...
Remove hostflags from PySSLContext as that was only needed for OpenSSL versions prior to 1.1.1
2025-04-18 15:27:32 -07:00
ce31ae5209
gh-129719: Restore missing `socket.CAN_RAW_ERR_FILTER` on Linux ( #129721 )
...
Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com>
Co-authored-by: Peter Bierma <zintensitydev@gmail.com>
2025-04-18 22:59:37 +03:00
2df0f88047
gh-132674: fix `_hashopenssl.c` compiler warnings on free-threaded build ( #132675 )
2025-04-18 13:52:17 +02:00
fc0ec29889
gh-103997: Automatically dedent the argument to "-c" ( #103998 )
...
Co-authored-by: sunmy2019 <59365878+sunmy2019@users.noreply.github.com>
Co-authored-by: Kirill Podoprigora <80244920+Eclips4@users.noreply.github.com>
Co-authored-by: Inada Naoki <songofacandy@gmail.com>
Co-authored-by: Adam Turner <9087854+AA-Turner@users.noreply.github.com>
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
2025-04-18 17:39:30 +09:00
50e518e886
gh-132097: allow AC to disable fastcall convention to avoid UBSan failures ( #131605 )
2025-04-18 10:15:40 +02:00
cf59bc3ae7
gh-127945: fix critical sections around ctypes array ( #132646 )
2025-04-17 18:44:14 +00:00
0c356c865a
gh-101410: Revert loghelper() change in 75f59bb for integer input (GH-132625)
2025-04-17 10:55:00 +03:00
b530e174a3
GH-131296: Remove unused variable from overlapped.c (GH-131590)
2025-04-16 22:44:57 +01:00
25717ff4bf
Remove unused headers from _asynciomodule.c file ( #132047 )
...
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
2025-04-16 18:20:41 +00:00
2925462411
gh-127945: change `_ctypes_test.c` static globals to thread local ( #132575 )
2025-04-16 23:11:27 +05:30
014c7f9047
gh-130052: Fix search_map_for_section() error handling ( #132594 )
...
* Don't call close() if the file descriptor is negative.
* If close() fails, chain the existing exception.
2025-04-16 13:56:58 +00:00
8cb177d09b
gh-132099: Accept an integer as the address for BTPROTO_HCI on Linux (GH-132525)
...
Previously only an integer packed in a tuple was accepted, while
getsockname() could return a raw integer.
Now the result of getsockname() is always acceptable as an address.
2025-04-16 13:02:51 +03:00
2ff5eb8582
gh-127945: move initialization of field desc to module exec in ctypes ( #132552 )
2025-04-15 19:30:33 +05:30
61638418a7
gh-70145: Add support for channels in Bluetooth HCI protocol (GH-132481)
2025-04-14 20:09:16 +03:00
4c12a2db15
gh-131757: allow lru_cache functions to execute concurrently ( #131758 )
2025-04-14 18:31:19 +02:00
be763e550e
gh-127945: fix thread safety and add lock held assertions to paramfunc in ctypes ( #132473 )
2025-04-14 14:05:06 +05:30
7a29c9883f
GH-115322: fix ctypes call_function audit hook on 32-bit platforms (GH-132496)
...
* GH-115322: fix ctypes call_function audit hook on 32-bit platforms.
It was using a signed conversion to communicate the function id (pointer) value.
2025-04-14 06:22:29 +00:00
1fc1df8dcc
gh-132099: Harmonize Bluetooth address handling (GH-132486)
...
Now all protocols always accept the Bluetooth address as string and
getsockname() always returns the Bluetooth address as string.
* BTPROTO_SCO now accepts not only bytes, but str.
* BTPROTO_SCO now checks address for embedded null.
* On *BSD, BTPROTO_HCI now accepts str instead of bytes.
* On FreeBSD, getsockname() for BTPROTO_HCI now returns str instead of bytes.
* On NetBSD and DragonFly BDS, BTPROTO_HCI now checks address for embedded null.
2025-04-14 08:58:56 +03:00
2666a06d33
GH-115322: Add missing audit hooks (GH-115624)
...
Add extra audit hooks to catch C function calling from ctypes,
reading/writing files through readline and executing external
programs through _posixsubprocess.
* Make audit-tests for open pass when readline.append_history_file is unavailable
* Less direct testing of _posixsubprocess for audit hooks
* Also remove the audit hook from call_cdeclfunction now that _ctypes_callproc does it instead.
* reword the NEWS entry.
* mention readline in NEWS
* add versionchanged markers
* fix audit_events.rst versionadded
* doc lint
---------
Co-authored-by: Gregory P. Smith <greg@krypto.org>
2025-04-13 21:46:20 +00:00
9d127e83b9
gh-123471: Make concurrent iteration over itertools.repeat safe under free-threading ( #131247 )
2025-04-13 13:26:58 +05:30
f2f86d3f45
gh-132429: Fix support of Bluetooth sockets on NetBSD and DragonFly BSD (GH-132431)
...
* Also add support for cid and bdaddr_type in the BTPROTO_L2CAP address on FreeBSD.
* Return cid in getsockname() for BTPROTO_L2CAP if it is not zero.
* Fix a compiler warning on FreeBSD.
2025-04-12 23:57:34 +03:00
2aab2db146
GH-132417: ctypes: Fix potential `Py_DECREF(NULL)` when handling functions returning `PyObject *` ( #132418 )
...
Some functions (such as `PyErr_Occurred`) with a `restype` set to `ctypes.py_object` may return NULL without setting an exception.
2025-04-12 07:40:34 +00:00
e0dffc54b8
gh-132097: fix runtime UB when calling expat handlers ( #132265 )
2025-04-12 09:20:11 +02:00
e5f8b2c703
gh-85302: Add support for BTPROTO_SCO on FreeBSD (GH-131981)
...
BTPROTO_SCO has been supported on FreeBSD since 2008.
2025-04-11 19:38:17 +03:00
26ae05e95c
gh-127405: Add ABIFLAGS to sysconfig variables on Windows (GH-131799)
2025-04-11 16:19:03 +01:00
1b49c8c71b
gh-131127: Minimal build support on systems using LibreSSL (GH-131128)
2025-04-11 15:35:12 +03:00
d687900f98
gh-128384: Use a context variable for warnings.catch_warnings (gh-130010)
...
Make `warnings.catch_warnings()` use a context variable for holding
the warning filtering state if the `sys.flags.context_aware_warnings`
flag is set to true. This makes using the context manager thread-safe in
multi-threaded programs.
Add the `sys.flags.thread_inherit_context` flag. If true, starting a new
thread with `threading.Thread` will use a copy of the context
from the caller of `Thread.start()`.
Both these flags are set to true by default for the free-threaded build
and false for the default build.
Move the Python implementation of warnings.py into _py_warnings.py.
Make _contextvars a builtin module.
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
2025-04-09 16:18:54 -07:00
d47584aae6
gh-131336: fix thread safety for ctypes functions ( #132232 )
2025-04-09 18:18:40 +00:00
487cf3c170
gh-132305: Make Argument Clinic code compatible with Python 3.10 ( #132306 )
2025-04-09 19:10:02 +01:00
f5f1ac84b3
gh-112068: C API: Add support of nullable arguments in PyArg_Parse (GH-121303)
2025-04-08 22:08:00 +03:00
ab64130b57
gh-132250: Clear error in lsprof callback when method descriptor raises an excep… ( #132251 )
2025-04-08 13:36:47 -04:00
f7305a06c7
gh-115942: Add `locked` to several multiprocessing locks ( #115944 )
...
Co-authored-by: mpage <mpage@cs.stanford.edu>
Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
2025-04-08 11:14:12 +03:00
c0de650024
gh-131809: Upgrade vendored expat to 2.7.1 ( #132192 )
2025-04-07 23:42:00 +03:00
8e260b384a
gh-128182: switch `ctypes` locking to critical sections ( #132133 )
...
Co-authored-by: Kumar Aditya <kumaraditya@python.org>
2025-04-07 22:00:31 +05:30
3980718710
gh-132171: Fix `_interpreters.run_string` crash on string subclass ( #132173 )
2025-04-07 14:59:44 +03:00
f2daa96c81
gh-132174: Fix function name in error message of `_interpreters.run_string` ( #132175 )
...
Co-authored-by: Brian Schubert <brianm.schubert@gmail.com>
2025-04-07 11:23:52 +03:00
af8d1b9537
gh-122040: reword `Modules/xxmodule.c` module-level comment ( #132201 )
2025-04-07 08:03:03 +00:00
b865871486
gh-99108: add support for SIMD-accelerated HMAC-BLAKE2 ( #132120 )
2025-04-07 09:31:17 +02:00
0dba59e689
gh-128182: add critical sections to ctypes arrays getters and setters ( #132152 )
2025-04-06 16:21:44 +05:30
1755157207
GH-118761: Expose more core interpreter types in ``_types`` ( #132103 )
...
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
Co-authored-by: Peter Bierma <zintensitydev@gmail.com>
2025-04-05 18:11:07 +00:00
d827d4d018
gh-131591: Fix GENERATE_DEBUG_SECTION for clangcl on Windows (GH-132112)
2025-04-06 00:00:54 +08:00
b9d8d99563
gh-128182: add critical section to `_ctypes.Simple` getters and setters ( #132081 )
2025-04-05 10:27:41 +00:00
f7a8bc50db
gh-128182: add critical section to `_ctypes.PyCData` methods ( #132082 )
2025-04-05 15:24:58 +05:30
231a50fa9a
gh-109599: Expose `CapsuleType` via the `_types` module ( #131969 )
2025-04-04 23:37:41 +01:00
0a97427ee5
gh-99108: Implement HACL* HMAC ( #130157 )
...
A new extension module, `_hmac`, now exposes the HACL* HMAC (formally verified) implementation.
The HACL* implementation is used as a fallback implementation when the OpenSSL implementation of HMAC
is not available or disabled. For now, only named hash algorithms are recognized and SIMD support provided
by HACL* for the BLAKE2 hash functions is not yet used.
2025-04-04 19:04:00 +02:00
04bc681e7c
gh-131938: Update exception message for `Element.remove()` when an element is not found ( #131972 )
...
The exception message for `xml.etree.ElementTree.Element.remove` when an element is not found
has been updated from "list.remove(x): x not in list" to "Element.remove(x): element not found".
2025-04-04 15:04:07 +00:00
345baa77ba
gh-132075: Fix possible use of sockaddr structures with uninitialized members (GH-132076)
...
Now all structure members are initialized with zeroes by default.
2025-04-04 17:09:58 +03:00
6e91d1f9aa
gh-131974: Fix usages of `locked_deref` in `ctypes` ( #131975 )
2025-04-02 17:04:25 +02:00
e9556e1004
GH-131296: Disable MSVC-specific optimization in sre.c when compiling with clang-cl (GH-131593)
2025-04-01 17:29:45 +01:00
edbf7fb129
gh-111178: remove redundant casts for functions with correct signatures ( #131673 )
2025-04-01 17:18:11 +02:00
8cd29c2b53
gh-111178: Fix getsockaddrarg() undefined behavior ( #131668 )
...
Don't pass direct references to sockaddr members since their type may
not match PyArg_ParseTuple() types. Instead, use temporary 'int' and
'unsigned char' variables, and update sockaddr members afterwards.
On FreeBSD, treat BTPROTO_HCI node name as a bytes string,
not as an integer.
2025-04-01 13:54:27 +00:00
511d3440a0
gh-131936: Strengthen check in `_suggestions._generate_suggestions` ( #131945 )
2025-03-31 19:30:29 +02:00
9127b4602e
GH-131296: Fix incompatible pointer type warning in _winapi.c (GH-131600)
2025-03-31 17:33:55 +01:00
7cbcb6efd9
GH-131296: Fix parenthesis warnings on Windows-specific code (GH-131905)
2025-03-31 15:54:30 +01:00
bab1398a47
gh-126033: fix UAF in `xml.etree.ElementTree.Element.remove` when concurrent mutations happen ( #126124 )
2025-03-31 12:31:26 +02:00
c57623c221
gh-126037: fix UAF in `xml.etree.ElementTree.Element.find*` when concurrent mutations happen ( #127964 )
...
We fix a use-after-free in the `find`, `findtext` and `findall` methods of `xml.etree.ElementTree.Element`
objects that can be triggered when the tag to find implements an `__eq__` method that mutates the
element being queried.
2025-03-31 12:26:52 +02:00
46ada1e5e0
gh-127945: acquire critical section around `PyCFuncPtr_call` ( #131898 )
2025-03-30 11:01:12 +00:00
28e476f6a2
gh-127945: make initialization of `error_object_name` thread safe in ctypes ( #131896 )
2025-03-30 10:50:35 +00:00
bc5a028c13
gh-127945: fix thread safety of creating instances of ctypes structures ( #131716 )
2025-03-30 15:22:30 +05:30
d260631be0
gh-131423: Update to OpenSSL 3.0.16. (GH-131839)
...
The bin tag is 3.0.16.1 because we rebuilt without uplink support to fix gh-131804.
This PR also prevents making calls that are now unsafe without uplink, and updates
the tests to property interpret these failures as unsupported.
2025-03-28 15:07:57 +00:00
8614f86b71
gh-131525: Cache the result of tuple_hash ( #131529 )
...
* gh-131525: Cache the result of tuple_hash
* Fix debug builds
* Add blurb
* Fix formatting
* Pre-compute empty tuple singleton
* Mostly set the cache within tuple_alloc
* Fixes for TSAN
* Pre-compute empty tuple singleton
* Fix for 32-bit platforms
* Assert that op != NULL in _PyTuple_RESET_HASH_CACHE
* Use FT_ATOMIC_STORE_SSIZE_RELAXED macro
* Update Include/internal/pycore_tuple.h
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
* Fix alignment
* atomic load
* Update Objects/tupleobject.c
Co-authored-by: Chris Eibl <138194463+chris-eibl@users.noreply.github.com>
---------
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
Co-authored-by: Chris Eibl <138194463+chris-eibl@users.noreply.github.com>
2025-03-27 09:57:06 -04:00
67fbfb42bd
gh-131586: Avoid refcount contention in some "special" calls ( #131588 )
...
In the free threaded build, the `_PyObject_LookupSpecial()` call can lead to
reference count contention on the returned function object becuase it
doesn't use stackrefs. Refactor some of the callers to use
`_PyObject_MaybeCallSpecialNoArgs`, which uses stackrefs internally.
This fixes the scaling bottleneck in the "lookup_special" microbenchmark
in `ftscalingbench.py`. However, the are still some uses of
`_PyObject_LookupSpecial()` that need to be addressed in future PRs.
2025-03-26 14:38:47 -04:00
90b82f2b61
gh-129900: Fix `SystemExit` return codes when the REPL is started from the command line ( #129901 )
2025-03-25 19:48:46 +00:00
f1967e7249
gh-127945: fix thread safety of ctypes state ( #131710 )
...
This fixes thread safety of `array_cache` and `swapped_suffix` by initializing them in module exec to make it thread safety.
2025-03-25 17:03:05 +05:30
96ef4c511f
gh-127945: add locking to malloc closure in free-threading ( #131662 )
...
The freelist is not thread safe in free-threading so this adds lock around it make it thread safe in free-threading.
2025-03-25 16:48:46 +05:30
5fef4ff9ed
gh-111178: Fix function signature in pyexpat.c ( #131674 )
...
Move _Py_NO_SANITIZE_UNDEFINED macro from faulthandler.c to pyport.h.
2025-03-24 17:22:45 +00:00
69e94e0a1b
gh-111178: Fix function signatures for test_socket ( #131667 )
...
Add unicode_fsdecode() wrapper for PyUnicode_DecodeFSDefault() to use
the correct API for Py_BuildValue() converter API.
2025-03-24 14:51:32 +00:00
6226edc48b
gh-111178: Fix function signatures for test_capi ( #131659 )
...
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
2025-03-24 14:04:45 +00:00
78f1bac7f2
gh-111178: Fix function signature for test_threading ( #131663 )
2025-03-24 13:56:45 +00:00
4596666a9f
gh-111178: Fix function signatures for test_zoneinfo ( #131664 )
2025-03-24 14:32:46 +01:00
abcd9d4f7d
gh-111178: Fix function signatures for test_ctypes ( #131660 )
2025-03-24 14:30:13 +01:00
0e53038ea8
gh-128715: Expose ctypes.CField, with info attributes (GH-128950)
...
- Restore max field size to sys.maxsize, as in Python 3.13 & below
- PyCField: Split out bit/byte sizes/offsets.
- Expose CField's size/offset data to Python code
- Add generic checks for all the test structs/unions, using the newly exposed attrs
2025-03-24 14:18:34 +01:00
62fb15d866
gh-131311: Extract _replace_array_elements from PyCStructUnionType_update_stginfo (GH-131504)
2025-03-24 13:55:09 +01:00
04d4aacaac
gh-128485: ensure that dlmalloc initializes itself at import time in ctypes ( #131633 )
2025-03-24 18:14:25 +05:30
9c4fb92e12
gh-131311: Fix additional memory leaks in ctypes (GH-131429)
...
* Visit keep in StructParam_traverse
* Decref swapped in PyCSimpleType_init
* Decref ob in make_funcptrtype_dict
* Check Pointer_item result while constructing result list in Pointer_subscript
* Fix align and size naming in PyCStructUnionType_update_stginfo
- as discussed in previous PR
2025-03-24 13:42:10 +01:00
af29d5cfd1
gh-111178: fix UBSan failures for `Modules/_testcapimodule.c` ( #131614 )
...
Fix UBSan failures for various classes in `Modules/_testcapimodule.c`,
remove some redundant casts and add some `Py_UNUSED()` usages.
2025-03-24 10:14:22 +00:00
491b8141f5
gh-111178: fix UBSan failures for `Modules/_testcapi/{buffer,monitoring}.c` ( #131613 )
2025-03-24 11:06:37 +01:00
45191797d8
gh-111178: fix UBSan failures for `Modules/_testmultiphase.c` ( #131615 )
2025-03-24 10:59:30 +01:00
82e541bf91
gh-111178: fix UBSan failures for `Modules/_testbuffer.c` ( #131612 )
2025-03-24 10:46:25 +01:00
ef06508f8e
gh-111178: fix UBSan failures for `TaskStepMethWrapper` ( #131602 )
2025-03-23 19:56:03 +05:30
a9a399f0ec
gh-131418: remove unused legacy typedefs in `{md5,sha1}module.c` ( #131420 )
...
- Remove legacy typedefs `MD5_INT32` and `MD5_INT64` in `Modules/md5module.c`
- Remove legacy typedefs `SHA1_INT32` and `SHA1_INT64` in `Modules/sha1module.c`.
Those legacy typedefs were used to detect whether the host platform could
correctly implement MD5 and SHA-1, but this is no longer needed as we now
fallback to HACL* implementations.
2025-03-23 12:19:26 +01:00
bc26f95e8f
GH-131296: fix clang-cl warning on Windows in semaphore.c (GH-131595)
...
fix clangcl warning
2025-03-22 15:44:56 -07:00
1a082085ae
gh-131238: Remove pycore_object_deferred.h from pycore_object.h ( #131549 )
...
Remove also pycore_function.h from pycore_typeobject.h.
2025-03-21 16:44:10 +00:00
b70d45ab22
gh-131268: Implement thread names on OpenBSD ( #131528 )
2025-03-21 11:12:35 +01:00
e0fda794fa
gh-70647: Raise a more informative error for when date is out of range (GH-131335)
...
More informative error messages mean less debugging what went wrong.
2025-03-20 20:47:09 -07:00
7ebd71ee14
GH-131498: Remove conditional stack effects (GH-131499)
...
* Adds some missing #includes
2025-03-20 15:39:38 +00:00
b69da006a4
gh-131238: Remove includes from pycore_interp.h ( #131495 )
...
Remove also now unused includes in C files.
2025-03-20 11:35:23 +00:00
34c1ea3109
gh-111178: Fix function signatures for multiple tests ( #131496 )
2025-03-20 12:27:03 +01:00
486d537065
Fix Windows build warnings ( #131487 )
...
Fix the following warnings:
* Modules\_io\fileio.c(1296,13): unused variable 'self'
* Modules\_io\winconsoleio.c(334,9): unused variable 'fd_is_own'
* Modules\faulthandler.c(409,11): unused variable 'flags'
* Modules\posixmodule.c(5699,9): unused variable 'pathError'
* PC\winreg.c(2077,5): suggest braces around initialization of
subobject
* PC\winreg.c(34,13): unused variable 'errNotAHandle'
* Python\fileutils.c(132,12): result of comparison of constant
1114111 with expression of type 'wchar_t' (aka 'unsigned short') is
always false
* Python\fileutils.c(58,21): unused variable 'INCOMPLETE_CHARACTER'
* Python\sysmodule.c(2534,21): unused variable 'perf_map_state'
2025-03-20 12:03:20 +01:00
20c5f969dd
gh-131238: Remove more includes from pycore_interp.h ( #131480 )
2025-03-19 23:01:32 +01:00
63a638c43f
gh-91349: Replace zlib with zlib-ng in Windows build (GH-131438)
2025-03-19 19:03:25 +00:00
5c44d7d99c
gh-130931: Add pycore_interpframe.h internal header ( #131249 )
...
Move _PyInterpreterFrame and associated functions
to a new pycore_interpframe.h header.
2025-03-19 18:17:44 +01:00
4b54031323
gh-131238: Remove pycore_runtime.h from pycore_pystate.h ( #131356 )
...
* Remove includes from pycore_pystate.h:
* pycore_runtime_structs.h
* pycore_runtime.h
* pycore_tstate.h
* pycore_interp.h
* Reorganize internal headers. Move _gc_thread_state from
pycore_interp_structs.h to pycore_tstate.h.
* Add 3 new header files to PCbuild/pythoncore.vcxproj.
2025-03-19 17:33:24 +01:00
6935d96e9c
gh-111178: Fix function signatures in _testbuffer.c ( #131463 )
2025-03-19 16:54:18 +01:00
f5e4c2955b
gh-111178: Fix function signatures for test_iter ( #131456 )
2025-03-19 14:42:51 +01:00
Sergey B Kirpichev