在时间序列中找到阶梯（或尖峰）形状的pythonic方法是什么？

Question

我有一个 Pandas 数据框（例如 df），其中一些值突然跳跃（如步进或尖峰）。识别它们的最佳方法是什么？

我写了一个非常简单的代码，通过它计算了几个下一个和上一个值的差异。然后通过比较这些，程序将决定是阶梯还是尖峰。

# to create a dataframe
df=pd.DataFrame(np.random.randn(25), index=pd.date_range(start='2010-1-1',end='2010-1-2',freq='H'), columns=['value'])

# to manipulate the dataframe
df[10:11] = -0.933463
df[11:12] = 15
df[12:13] = 15
df[13:14] = 15

# to calculated the differnces of a value with a couple next and previous values
df_diff = pd.DataFrame()
df_diff['p1'] = df['value'].diff(periods=1).abs()
df_diff['p2'] = df['value'].diff(periods=2).abs()
df_diff['n1'] = df['value'].diff(periods=-1).abs()
df_diff['n2'] = df['value'].diff(periods=-2).abs()

max=5  # as an eligible maximum value
results =  (df_diff['n1'] >max) & (df_diff['n1'] == df_diff['n2']) & (df_diff['p1']==0)

我期望的是：

2010-01-01 00:00:00    False
2010-01-01 01:00:00    False
2010-01-01 02:00:00    False
2010-01-01 03:00:00    False
2010-01-01 04:00:00    False
2010-01-01 05:00:00    False
2010-01-01 06:00:00    False
2010-01-01 07:00:00    False
2010-01-01 08:00:00    False
2010-01-01 09:00:00    False
2010-01-01 10:00:00    True
2010-01-01 11:00:00    True
2010-01-01 12:00:00    True
2010-01-01 13:00:00    True
2010-01-01 14:00:00    True
2010-01-01 15:00:00    False
2010-01-01 16:00:00    False
2010-01-01 17:00:00    False
2010-01-01 18:00:00    False
2010-01-01 19:00:00    False
2010-01-01 20:00:00    False
2010-01-01 21:00:00    False
2010-01-01 22:00:00    False
2010-01-01 23:00:00    False
2010-01-02 00:00:00    False

Answer 1

您为下降峰值 ( ) 选择的值df[10:11] = -0.933463太低，无法在没有更多信息的情况下将其与其他低点区分开来。

所以我把这个值改为-7。

from scipy.signal import find_peaks
import pandas as pd
import numpy as np

# to create a dataframe
np.random.seed(42)
df=pd.DataFrame(np.random.randn(25), index=pd.date_range(start='2010-1-1',end='2010-1-2',freq='H'), columns=['value'])

# to manipulate the dataframe
df[10:11] = -7
df[11:12] = 15
df[12:13] = 15
df[13:14] = 15

peaks_up = find_peaks(df.value, prominence=4, plateau_size=1)
peaks_down = find_peaks(-df.value, prominence=4, plateau_size=1)

peaks_idx = np.unique(
    np.concatenate(
        [peaks_up[1]['left_edges'], peaks_up[0], peaks_up[1]['right_edges'],
         peaks_down[1]['left_edges'], peaks_down[0], peaks_down[1]['right_edges']],
        axis=0))
peaks_df = df.iloc[peaks_idx ]

绘制：

import matplotlib.pyplot as plt
import seaborn as sns

sns.lineplot(df.index, df.value)
plt.scatter(peaks_df.index, peaks_df.value, color="red")