<?xml version="1.0" encoding="utf-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:hal="http://hal.archives-ouvertes.fr/" xmlns:gml="http://www.opengis.net/gml/3.3/" xmlns:gmlce="http://www.opengis.net/gml/3.3/ce" version="1.1" xsi:schemaLocation="http://www.tei-c.org/ns/1.0 http://api.archives-ouvertes.fr/documents/aofr-sword.xsd">
  <teiHeader>
    <fileDesc>
      <titleStmt>
        <title>HAL TEI export of hal-00554324</title>
      </titleStmt>
      <publicationStmt>
        <distributor>CCSD</distributor>
        <availability status="restricted">
          <licence target="https://creativecommons.org/publicdomain/zero/1.0/">CC0 1.0 - Universal</licence>
        </availability>
        <date when="2026-05-24T14:21:07+02:00"/>
      </publicationStmt>
      <sourceDesc>
        <p part="N">HAL API Platform</p>
      </sourceDesc>
    </fileDesc>
  </teiHeader>
  <text>
    <body>
      <listBibl>
        <biblFull>
          <titleStmt>
            <title xml:lang="en">Statistical Linearization for Value Function Approximation in Reinforcement Learning</title>
            <author role="aut">
              <persName>
                <forename type="first">Matthieu</forename>
                <surname>Geist</surname>
              </persName>
              <email type="md5">c025140e3cc06ac39e7de0f0db2a4b70</email>
              <email type="domain">univ-lorraine.fr</email>
              <idno type="idhal" notation="string">matthieu-geist</idno>
              <idno type="idhal" notation="numeric">6945</idno>
              <idno type="halauthorid" notation="string">7492-6945</idno>
              <affiliation ref="#struct-26305"/>
            </author>
            <editor role="depositor">
              <persName>
                <forename>Sébastien</forename>
                <surname>Van Luchene</surname>
              </persName>
              <email type="md5">983556412cb0e7fb6d6508a01ac9cf46</email>
              <email type="domain">supelec.fr</email>
            </editor>
          </titleStmt>
          <editionStmt>
            <edition n="v1" type="current">
              <date type="whenSubmitted">2011-01-10 15:59:24</date>
              <date type="whenModified">2023-02-14 03:37:45</date>
              <date type="whenReleased">2011-01-10 16:11:58</date>
              <date type="whenProduced">2010-12-10</date>
            </edition>
            <respStmt>
              <resp>contributor</resp>
              <name key="123540">
                <persName>
                  <forename>Sébastien</forename>
                  <surname>Van Luchene</surname>
                </persName>
                <email type="md5">983556412cb0e7fb6d6508a01ac9cf46</email>
                <email type="domain">supelec.fr</email>
              </name>
            </respStmt>
          </editionStmt>
          <publicationStmt>
            <distributor>CCSD</distributor>
            <idno type="halId">hal-00554324</idno>
            <idno type="halUri">https://centralesupelec.hal.science/hal-00554324</idno>
            <idno type="halBibtex">geist:hal-00554324</idno>
            <idno type="halRefHtml">&lt;i&gt;NIPS Workshop on Learning and Planning from Batch Time Series Data (OPT 2010)&lt;/i&gt;, Dec 2010, Vancouver, Canada. pp.1-6</idno>
            <idno type="halRef">NIPS Workshop on Learning and Planning from Batch Time Series Data (OPT 2010), Dec 2010, Vancouver, Canada. pp.1-6</idno>
            <availability status="restricted"/>
          </publicationStmt>
          <seriesStmt>
            <idno type="stamp" n="SUPELEC">SUPELEC</idno>
            <idno type="stamp" n="CENTRALESUPELEC">Ecole CentraleSupélec</idno>
          </seriesStmt>
          <notesStmt>
            <note type="audience" n="2">International</note>
            <note type="invited" n="0">No</note>
            <note type="popular" n="0">No</note>
            <note type="peer" n="1">Yes</note>
            <note type="proceedings" n="0">No</note>
          </notesStmt>
          <sourceDesc>
            <biblStruct>
              <analytic>
                <title xml:lang="en">Statistical Linearization for Value Function Approximation in Reinforcement Learning</title>
                <author role="aut">
                  <persName>
                    <forename type="first">Matthieu</forename>
                    <surname>Geist</surname>
                  </persName>
                  <email type="md5">c025140e3cc06ac39e7de0f0db2a4b70</email>
                  <email type="domain">univ-lorraine.fr</email>
                  <idno type="idhal" notation="string">matthieu-geist</idno>
                  <idno type="idhal" notation="numeric">6945</idno>
                  <idno type="halauthorid" notation="string">7492-6945</idno>
                  <affiliation ref="#struct-26305"/>
                </author>
              </analytic>
              <monogr>
                <title level="m">Proceedings of 3rd International Workshop on Optimization for Machine Learning</title>
                <meeting>
                  <title>NIPS Workshop on Learning and Planning from Batch Time Series Data (OPT 2010)</title>
                  <date type="start">2010-12-10</date>
                  <settlement>Vancouver</settlement>
                  <country key="CA">Canada</country>
                </meeting>
                <imprint>
                  <biblScope unit="pp">1-6</biblScope>
                  <date type="datePub">2010</date>
                </imprint>
              </monogr>
            </biblStruct>
          </sourceDesc>
          <profileDesc>
            <langUsage>
              <language ident="en">English</language>
            </langUsage>
            <textClass>
              <classCode scheme="halTypology" n="COMM">Conference papers</classCode>
              <classCode scheme="halOldTypology" n="COMM">Conference papers</classCode>
              <classCode scheme="halTreeTypology" n="COMM">Conference papers</classCode>
            </textClass>
            <abstract xml:lang="en">
              <p>Reinforcement learning (RL) is a machine learning answer to the optimal control problem. It consists in learning an optimal control policy through interactions with the system to be controlled, the quality of this policy being quantified by the so-called value function. An important RL subtopic is to approximate this function when the system is too large for an exact representation. This paper presents statistical-linearization-based approaches to estimate such functions. Compared to more classical approaches, this allows considering nonlinear parameterizations as well as the Bellman optimality operator, which induces some differentiability problems. Moreover, the statistical point of view adopted here allows considering colored observation noise models instead of the classical white one; in RL, this can provide useful.</p>
            </abstract>
          </profileDesc>
        </biblFull>
      </listBibl>
    </body>
    <back>
      <listOrg type="structures">
        <org type="laboratory" xml:id="struct-26305" status="OLD">
          <orgName>SUPELEC-Campus Metz</orgName>
          <date type="start">1985-01-01</date>
          <date type="end">2014-12-31</date>
          <desc>
            <address>
              <addrLine>2 rue Edouard Belin 57070 Metz</addrLine>
              <country key="FR"/>
            </address>
            <ref type="url">http://www.metz.supelec.fr/metz/</ref>
          </desc>
          <listRelation>
            <relation active="#struct-303397" type="direct"/>
          </listRelation>
        </org>
        <org type="institution" xml:id="struct-303397" status="VALID">
          <orgName>Ecole Supérieure d'Electricité - SUPELEC (FRANCE)</orgName>
          <desc>
            <address>
              <country key="FR"/>
            </address>
          </desc>
        </org>
      </listOrg>
    </back>
  </text>
</TEI>