Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 7, 2026

• [SPARK-55450][SS][PYTHON][DOCS] Document admission control in PySpark streaming data sources

  Show description for 98cdaee
  

  jiteshsoni

  authored and

  HeartSaVioR

  committed
  98cdaee

  Copy full SHA for 98cdaee

Commits on Feb 18, 2026

• [SPARK-55586][EXAMPLE] Add `jdbc.py` Example

  Show description for b9c2a41
  dongjoon-hyun

  committed
  b9c2a41

  Copy full SHA for b9c2a41

Commits on Feb 9, 2026

• [SPARK-55355][PYTHON] Upgrade mypy version to the latest

  Show description for b4b8165
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  b4b8165

  Copy full SHA for b4b8165

Commits on Nov 5, 2025

• [SPARK-53731][PYTHON] Update the type hints of iterator APIs

  Show description for 9de0a27
  zhengruifeng

  committed
  9de0a27

  Copy full SHA for 9de0a27

Commits on May 3, 2025

• [SPARK-51950][BUILD] Upgrade `Parquet` to 1.15.2

  Show description for 15732fc
  dongjoon-hyun

  committed
  15732fc

  Copy full SHA for 15732fc

Commits on Apr 29, 2025

• [MINOR][DOCS] Minor update to example

  Show description for 84c9727
  

  CarterFendley

  authored and

  dongjoon-hyun

  committed
  84c9727

  Copy full SHA for 84c9727

• [SPARK-51802][PYTHON][DOCS] OSS PySpark User Guide Docs

  Show description for 02faae5
  

  asl3

  authored and

  HyukjinKwon

  committed
  02faae5

  Copy full SHA for 02faae5

Commits on Nov 6, 2024

• [SPARK-37178][ML] Add Target Encoding to ml.feature

  Show description for abe990e
  

  Enrique Rebollo

  and

  HyukjinKwon

  committed
  abe990e

  Copy full SHA for abe990e

Commits on Jun 2, 2024

• [SPARK-48220][PYTHON] Allow passing PyArrow Table to createDataFrame()

  Show description for bc18701
  

  ianmcook

  authored and

  HyukjinKwon

  committed
  bc18701

  Copy full SHA for bc18701

Commits on May 9, 2024

• [SPARK-47365][PYTHON] Add toArrow() DataFrame method to PySpark

  Show description for ecca1bf
  

  ianmcook

  and

  HyukjinKwon

  committed
  ecca1bf

  Copy full SHA for ecca1bf

Commits on Apr 4, 2024

• [SPARK-47683][PYTHON][BUILD] Decouple PySpark core API to pyspark.core package

  Show description for 678aeb7
  HyukjinKwon

  committed
  678aeb7

  Copy full SHA for 678aeb7

Commits on Mar 6, 2024

• [SPARK-44746][PYTHON] Add more Python UDTF documentation for functions that accept input tables

  Show description for e0d7910
  

  dtenedor

  authored and

  HyukjinKwon

  committed
  e0d7910

  Copy full SHA for e0d7910

Commits on Nov 22, 2023

• [SPARK-46013][PYTHON][SQL][DOCS] Improve data source load and save functions docs page

  Show description for f0cdb09
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  f0cdb09

  Copy full SHA for f0cdb09

Commits on Oct 24, 2023

• [SPARK-44752][SQL] XML: Update Spark Docs

  Show description for a484826
  

  laglangyue

  authored and

  HyukjinKwon

  committed
  a484826

  Copy full SHA for a484826

Commits on Sep 8, 2023

• [SPARK-44508][PYTHON][DOCS] Add user guide for Python user-defined table functions

  Show description for aaf413c
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  aaf413c

  Copy full SHA for aaf413c

Commits on Jul 19, 2023

• [SPARK-44401][PYTHON][DOCS] Arrow Python UDF Use Guide

  Show description for bdea4c5
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  bdea4c5

  Copy full SHA for bdea4c5

Commits on Oct 3, 2022

• [SPARK-40509][SS][PYTHON][FOLLLOW-UP] Add example for applyInPandasWithState followup

  Show description for 0870822
  

  chaoqin-li1123

  authored and

  HyukjinKwon

  committed
  0870822

  Copy full SHA for 0870822

Commits on Sep 28, 2022

• [SPARK-40509][SS][PYTHON] Add example for applyInPandasWithState

  Show description for 38599e9
  

  chaoqin-li1123

  authored and

  HeartSaVioR

  committed
  38599e9

  Copy full SHA for 38599e9

Commits on Aug 5, 2022

• [SPARK-39986][PS][DOC] Better example for Co-grouped Map

  Show description for 82dc17c
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  82dc17c

  Copy full SHA for 82dc17c

Commits on Apr 12, 2022

• [SPARK-38767][SQL] Support `ignoreCorruptFiles` and `ignoreMissingFiles` in Data Source options

  Show description for a92ef00
  

  Yaohua628

  authored and

  dongjoon-hyun

  committed
  a92ef00

  Copy full SHA for a92ef00

Commits on Mar 16, 2022

• [SPARK-38424][PYTHON] Warn unused casts and ignores

  Show description for f84018a
  

  zero323

  authored and

  HyukjinKwon

  committed
  f84018a

  Copy full SHA for f84018a

Commits on Jan 10, 2022

• [SPARK-37852][PYTHON][INFRA] Enable flake's E741 rule in PySpark

  Show description for bd24b48
  

  HyukjinKwon

  authored and

  zero323

  committed
  bd24b48

  Copy full SHA for bd24b48

Commits on Jan 7, 2022

• [SPARK-37836][PYTHON][INFRA] Enable F841, E722, E305 and E226 for PEP 8 compliance

  Show description for 9000339
  HyukjinKwon

  committed
  9000339

  Copy full SHA for 9000339

Commits on Dec 23, 2021

• [SPARK-34544][PYTHON] Convert PandasDataFrameLike and PandasSeriesLike to aliases of Pandas types

  Show description for a70006d
  zero323

  committed
  a70006d

  Copy full SHA for a70006d

Commits on Nov 19, 2021

• [SPARK-36997][PYTHON][TESTS] Run mypy tests against ml, sql, streaming and core examples

  Show description for 53f9334
  zero323

  committed
  53f9334

  Copy full SHA for 53f9334

Commits on Oct 21, 2021

• [SPARK-36654][PYTHON] Drop type ignores from numpy imports

  Show description for dc60791
  zero323

  committed
  dc60791

  Copy full SHA for dc60791

Commits on Aug 24, 2021

• Revert "[SPARK-34415][ML] Randomization in hyperparameter optimization"

  Show description for de932f5
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  de932f5

  Copy full SHA for de932f5

Commits on Jul 28, 2021

• [SPARK-36314][SS] Update Sessionization examples to use native support of session window

  Show description for 1fafa8e
  

  HeartSaVioR

  authored and

  viirya

  committed
  1fafa8e

  Copy full SHA for 1fafa8e

Commits on Apr 12, 2021

• [SPARK-34562][SQL] Add test and doc for Parquet Bloom filter push down

  Show description for e40fce9
  

  wangyum

  authored and

  MaxGekk

  committed
  e40fce9

  Copy full SHA for e40fce9

Commits on Apr 7, 2021

• [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

  Show description for 8e15ac1
  

  itholic

  authored and

  MaxGekk

  committed
  8e15ac1

  Copy full SHA for 8e15ac1

Commits on Apr 5, 2021

• [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents

  Show description for a72f0d7
  

  twoentartian

  authored and

  HyukjinKwon

  committed
  a72f0d7

  Copy full SHA for a72f0d7

Commits on Mar 18, 2021

• [SPARK-34760][EXAMPLES] Replace `favorite_color` with `age` in JavaSQLDataSourceExample

  Show description for 5570f81
  

  zengruios

  authored and

  yaooqinn

  committed
  5570f81

  Copy full SHA for 5570f81

Commits on Feb 28, 2021

• [SPARK-34415][ML] Python example

  Show description for 5a48eb8
  

  PhillHenry

  authored and

  srowen

  committed
  5a48eb8

  Copy full SHA for 5a48eb8

Commits on Jan 16, 2021

• [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

  Show description for f354883
  

  huaxingao

  authored and

  WeichenXu123

  committed
  f354883

  Copy full SHA for f354883

Commits on Nov 22, 2020

• [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

  Show description for d338af3
  

  cchighman

  and

  HeartSaVioR

  committed
  d338af3

  Copy full SHA for d338af3