scieee AI-readable full text Open interactive document viewer

Semantics-Aware Updates From Remote Energy Harvesting Devices to Interconnected LEO Satellites

Delfani, Erfan; Pappas, Nikolaos

Abstract

Providing timely and informative data in integrated terrestrial and non-terrestrial networks is critical as data volume grows while the resources available on devices remain limited. To address this, we adopt a semantics-aware approach to optimize the Version Age of Information (VAoI) in a status update system in which a remote Energy Harvesting (EH) Internet of Things (IoT) device samples data and transmits it to a network of interconnected Low Earth Orbit (LEO) satellites for dissemination and utilization. The optimal update policy isderived through stochastic modeling and optimization of the VAoI across the network. The results indicate that this policy reduces the frequency of updates by skipping stale or irrelevant data, significantly improving energy efficiency.

Full text

See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/388920765 Semantics-Aware Updates from Remote IoT Devices to Interconnected LEO Satellites Preprint · February 2025 DOI: 10.48550/arXiv.2502.07069 CITATIONS 0 READS 32 2 authors: Erfan Delfani Linköping University 16 PUBLICATIONS41 CITATIONS SEE PROFILE Nikolaos Pappas Linköping University 372 PUBLICATIONS6,913 CITATIONS SEE PROFILE All content following this page was uploaded by Nikolaos Pappas on 13 February 2025. The user has requested enhancement of the downloaded file. arXiv:2502.07069v1 [cs.NI] 10 Feb 2025 1 Semantics-Aware Updates from Remote IoT Devices to Interconnected LEO Satellites Erfan Delfani, and Nikolaos Pappas, Senior Member, IEEE. Abstract—Providing timely and informative data in Integrated Terrestrial and Non-Terrestrial Networks (T-NTNs) is critical as data volume continues to grow while the resources available on devices remain limited. To address this, we adopt a semanticsaware approach to optimize the Version Age of Information (VAoI) in a status update system in which a remote Energy Harvesting (EH) Internet of Things (IoT) device samples data and transmits it to a network of interconnected Low Earth Orbit (LEO) satellites for dissemination and utilization. The optimal update policy is derived through stochastic modeling and optimization of the VAoI across the network. The results indicate that this policy reduces the frequency of updates by skipping stale or irrelevant data, significantly improving energy efficiency. Index Terms—Semantics-aware communication, Status update, Version AoI, IoT, Energy harvesting, LEO, Satellite networks. I. INTRODUCTION The integration of Terrestrial and Non-Terrestrial (T-NT) communication networks has unlocked new opportunities, enabling seamless extended coverage and enhanced remote communication and processing capabilities. Incorporating aerial and space platforms—such as Unmanned Aerial Vehicles (UAVs), High Altitude Platforms (HAPs), and satellites—provides critical infrastructure for connecting remote nodes in rural areas, islands, ships, and airplanes, facilitating global services [1]. Among NT networks, LEO satellites are experiencing rapid growth, forming a dense web of interconnected nodes around the Earth. These satellites can connect directly to ground devices and gateways, serving as end-users or relays to support global caching, processing, and information management. However, the hardware, software, and energy constraints of satellite nodes make efficient resource management essential for sustaining network performance, particularly when handling large volumes of data. This challenge is further amplified when dealing with time-sensitive data and real-time decision-making from remote IoT devices. In such scenarios, the communication of timely and informative data plays a crucial role in the performance of the network. The semantics-aware communication paradigm is a novel approach that optimizes the generation, transmission, and utilization of fresh and informative data [2]. In this framework, semantic attributes such as timeliness,relevance, and value are quantified using metrics like Age of Information (AoI) [3], Age of Incorrect Information (AoII) [4], and VAoI [5]. AoI measures data freshness but disregards its content. In contrast, The authors are with the Department of Computer and Information Science at Link¨oping University, Sweden, email: {erfan.delfani, nikolaos.pappas}@liu.se. This work has been supported in part by the Swedish Research Council (VR), ELLIIT, and the EU (ETHER, 101096526, ELIXIRION, 101120135, and SOVEREIGN, 101131481). AoII and VAoI account for content, with VAoI requiring only minimal knowledge of it. By optimizing these metrics, integrated T-NT networks can ensure the timely delivery of relevant information while minimizing the transmission of outdated or uninformative data. This approach not only enhances network efficiency but also significantly reduces energy consumption. Several studies have examined semantics-aware communication in LEO satellite networks, where the data may be utilized within the LEO network—for example, for distributed processing—or ultimately delivered to a ground destination node via dissemination in the LEO network. The works [6], [7] investigate AoI in multihop satellite networks under packet erasure channels and queuing policies, deriving closed-form bounds for both average and Peak AoI (PAoI). Path selection in dynamic LEO constellations with Inter-Satellite Link (ISL) interruptions is explored in [8], where AoI is optimized under path and arrival rate constraints. Access control mechanisms for minimizing PAoI in GEO/LEO heterogeneous networks for IoT gateways are examined in [9]. Optimization of average AoI in LEO satellite-terrestrial integrated networks is addressed in [10] through a Non-Orthogonal Multiple Access (NOMA)-based two-user scheme, with satellites offering orthogonal access for other users. Protocols for timely dualhop status updates in Satellite IoT (SIoT) systems, leveraging relaying LEO satellites to enhance PAoI over fading channels, are developed in [11], [12]. The work in [13] introduces an age-optimal delivery protocol for two-hop SIoT links, incorporating data compression, transmission scheduling, and spatial-temporal correlations. In [14], AoII is employed as a content-based metric, formulating an AoII minimization problem under power, network stability, and freshness constraints in a downlink NOMA-based status update system. Lastly, [15] proposes an LEO IoT architecture with edge intelligence for collaborative task processing, optimizing PAoI while considering terminal energy constraints. The aforementioned studies have predominantly emphasized the timeliness of information, particularly AoI and PAoI, while largely disregarding content-based metrics such as VAoI in LEO satellite networks. Additionally, they have primarily considered status updates from individual LEO satellites, failing to account for their interconnected topology. This work addresses these gaps with a semantics-aware approach to handling information from an energy-constrained IoT device to a network of interconnected LEO satellites arranged in a ring topology, a typical configuration enabled by permanent ISLs [16]. We analyze VAoI at LEO nodes and optimize its average across the network by adopting a transmission policy at the IoT device, subject to energy constraints in an EH scenario. 2 II. SYSTEM MODEL We consider a system model, as depicted in Fig. 1, where a remote EH IoT device measures and transmits status updates from an information source to a network of (N+ 1) LEO satellites in an orbital plane. During a visibility window, the IoT device connects to a satellite, referred to as the Connected Satellite (CS), and transmits updates according to an update policy, while adhering to the constraints imposed by the harvested energy stored in the device’s battery. The update policy, denoted by π, decides whether the device transmits a fresh update to the CS, thereby consuming energy, or remains idle to conserve energy for future use. This decision, or action, is made sequentially in each time slot along a slotted time axis. The device harvests energy from ambient sources and stores it in a battery with capacity B. The energy harvesting process follows a Bernoulli distribution with an arrival probability of β, which is commonly used as a general stochastic model [17], [18]. Each transmission to the CS consumes one energy unit and occupies one time slot. Furthermore, we assume the updates are propagated among destination satellites using a bidirectional ring topology, where updates received at the CS are disseminated to all network nodes. The ultimate objective is to derive an update policy that optimizes network performance, delivering timely and informative data while efficiently using energy, with the VAoI as the semantic performance metric. The VAoI is a semantic metric in status update systems that measures both the timeliness and relevance of information, reflecting how many versions the receiver lags behind the source as new content or versions are generated [5]. By labeling the new content at the source with version numbers, the VAoI at a destination node Dcan be defined as follows: ∆(t)def =VS(t)−VD(t),(1) where VS(t)is the version stored at the source, and VD(t) denotes the version stored at node Dat time t. We assume that a new version at the source is generated with probability pgin each time slot, following a Bernoulli distribution. Each node retains only the freshest version of the data, discarding previous versions. When the update policy determines that an update should be transmitted, the CS collects the latest data. These updates are propagated to neighboring nodes, which subsequently relay them to their respective neighbors, continuing the dissemination process. We assume that transmissions between neighboring satellites via ISLs are deterministic, occurring error-free and at regular intervals. Each transmission is completed within a single time slot. III. AVERAGE VAOIWITHIN THE SATELLITE NETWORK Our objective is to model the average VAoI in the satellite network and optimize it by deriving an optimal update policy. Considering a time horizon T, the time-average VAoI of the Fig. 1: Status updates from an IoT device to a network of (N+ 1) LEO satellites in an orbital plane. n-th satellite and the average VAoI across the entire network, for a given update policy π, are defined as follows: ¯ ∆π n,T def =1 T T−1 X t=0 E[∆π n(t)] (2) ¯ ∆π T def =1 N+ 1 N 2 X n=−N 2 ¯ ∆π n,T (3) where ∆π n(t)denotes the VAoI at the n-th satellite at time t under the policy π. Proposition 1. The VAoI at the n-th satellite, which is |n| hops away from the CS, is given by: ∆n(t) = ζ|n|(t)+∆0(t− |n|),(4) n∈−N 2,−N 2+1,···,N 2−1,N 2, where ∆0(t)denotes the VAoI at the Connected Satellite, and ζm(t)represents a Binomial process with parameters mand pg, i.e., ζm(t)∼Bin(m, pg), m ∈ {0,1,2,· · · }, and pgis the version generation probability at the source. Proof. The VAoI at node nin Fig. 1, which is |n|hops away from CS, is given by ∆n(t)=VS(t)−Vn(t), where VS(t)is the stored version at the source at time tand Vn(t)is the stored version at node nat time t. The current version at node nis equal to the stored version at the CS in the |n|-th slot prior: Vn(t) = V0(t− |n|).Therefore, we can rewrite the VAoI at node nas follows: ∆n(t) = VS(t)−V0(t− |n|) =VS(t)−VS(t− |n|) |{z } ζ|n|(t) +VS(t− |n|)−V0(t− |n|) |{z } ∆0(t−|n|) where we have defined ζ|n|(t)def =VS(t)−VS(t− |n|). This process measures the number of version generations at the source during the past |n|time slots. The version generation 3 at the source in each time slot follows a Bernoulli distribution with parameter pg. Consequently, the number of version generations at the source during |n|time slots follows a Binomial distribution, i.e., ζ|n|(t)∼Bin(|n|, pg). Equation (4) in Proposition 1 states that the VAoI at node nat time tis equal to the VAoI at the CS at |n|time slots earlier (i.e., at t− |n|), plus the number of version changes that occurred during the last |n|time slots. Lemma 1. Under the update policy π, the average VAoI at the n-th node and across the entire network of LEO satellites over Ttime slots are, respectively, given by: ¯ ∆π n,T =|n|pg+E"1 T T−1 X t=0 ∆π 0(t−|n|)#,(5) ¯ ∆π T=N(N+2) 4(N+1) pg+1 N+1 N 2 X n=−N 2 E"1 T T−1 X t=0 ∆π 0(t−|n|)#.(6) Proof. We can simplify (2) using (4): ¯ ∆π n,T =1 T T−1 X t=0 Eζ|n|(t)+∆π 0(t−|n|).(7) By substituting the expected value of the Binomial process ζ|n|(t), i.e., Eζ|n|(t)=|n|pg, the average VAoI at the n-th node can be further simplified: ¯ ∆π n,T =|n|pg+1 T T−1 X t=0 E[∆π 0(t−|n|)] (8) and by substituting (8) into (3), we obtain the average VAoI for the entire network: ¯ ∆π T=1 N+1 N 2 X n=−N 2(|n|pg+1 T T−1 X t=0 E[∆π 0(t−|n|)])(9) =N(N+2) 4(N+1) pg+1 T 1 N+1 N 2 X n=−N 2 T−1 X t=0 E[∆π 0(t−|n|)]. Lemma 1 shows that the average VAoI at a single node or across the network depends on the VAoI at the CS and the system parameters, Nand pg. Thus, optimizing them through the optimal policy π∗reduces to optimizing the VAoI at the CS. We proceed with the optimization of the Version VAoI across the entire network1in the following section. IV. OPTIMIZATION PROBLEM Our aim is to optimize the average VAoI in the network, as represented by (6). For a large time horizon, i.e., when T≫N 2, the time average of the VAoI process with small shifts remains constant; in other words: 1 T T−1 X t=0 ∆π 0(t− |n|)≈1 T T−1 X t=0 ∆π 0(t),|n| ≤ N 2.(10) 1We omit the optimization of the average VAoI at the n-th node, as it is directly obtained in a similar manner. Fig. 2: System setup between the IoT device and the Connected Satellite. Thus, for large values of T, specifically for an infinite horizon, we can summarize the average VAoI of the network by substituting (10) into (6) as follows: ¯ ∆π T=N(N+ 2) 4(N+ 1) pg+E"1 T T−1 X t=0 ∆π 0(t)#, T ≫N 2.(11) Therefore, the optimization of the average VAoI in the network can be formulated as follows: ¯ ∆∗def = min π∈Πlim T→∞ ¯ ∆π T,(12) ¯ ∆∗=N(N+ 2) 4(N+ 1) pg+ min π∈Πlim T→∞ E"1 T T−1 X t=0 ∆π 0(t)# |{z } ¯ ∆∗ 0 ,(13) where a standard infinite horizon average cost Markov Decision Process (MDP) problem is obtained: P1:¯ ∆∗ 0= min π∈Πlim T→∞ 1 TE"T−1 X t=0 ∆π 0(t)|s(0)#,(14) where s(0) denotes the initial state of the system variables, and Πrepresents the set of all feasible policies. This problem involves a status update system in which the EH IoT device measures the information source’s status and transmits it to the CS node over a wireless channel, which is typically errorprone, as shown in Fig. 2. The success probability of each update packet in a time slot is denoted by ps. The update policy πis a sequence of actions over time, represented by a(t), where a(t) = 1 indicates a transmission at time t, and a(t) = 0 denotes an idle action, conserving battery for later optimal use. An optimal policy, denoted by π∗, minimizes the average VAoI in problem P1. This optimal policy can be derived using dynamic programming algorithms such as the Relative Value Iteration Algorithm (RVIA) [19] for the MDP problem P1, characterized by a tuple <S,A, P, C >, where Srepresents the state space, Adenotes the action space, Pis the transition probability function, and Cis the cost function: •States: We define the state vector s(t)def = [b(t),∆(t)]T∈ S, where b(t)∈ {0,1,2,...,B}represents the state of the 4 device’s battery, and ∆(t)∈ {0,1,2,··· ,∆max}denotes the VAoI at the CS at time t. Here, we have omitted the subscript and superscript of ∆π 0(t)for simplicity. We have also truncated the high values of VAoI because exceedingly stale data in the network becomes useless and is skipped by the system; thus, counting these higher values is unnecessary. The resulting state space, S, is a finite set: Sdef =(b, ∆): b∈ {0,1,···, B},∆∈ {0,1,···,∆max}. •Actions: At time t, the action a(t) = 0 indicates remaining idle, while a(t) = 1 corresponds to transmitting an update. The action a(t)is restricted to 0whenever b(t) = 0. •Transition probabilities: Given the following equation: P[s(t+1)|s(t), a(t)]=P[b(t+1)|b(t), a(t)] (15) ×P[∆(t+1)|b(t),∆(t), a(t)] , the transition probabilities are presented in Section IV-A. •Cost function: The transition cost function is equal to the VAoI, i.e., Cs(t), a(t), s(t+ 1)def = ∆(t+ 1). A. Transition Probabilities The transition probabilities between the system states are presented by introducing the following Bernoulli processes: the energy arrival process, e(t), the channel success process, c(t), and the version generation process, z(t), given by: e(t)=(1w.p. β, 0w.p. ¯ β, c(t)=(1w.p. ps, 0w.p. ¯ps, z(t)=(1w.p. pg, 0w.p. ¯pg. (16) where ¯ βdef = 1−β,¯ps def = 1−ps, and ¯pg def = 1−pg. We can now describe the evolution of the states based on the explanation provided in Sections III and IV: b(t+1)=min {b(t)+e(t)−a(t), B}.(17) ∆(t+1)=(z(t), a(t)=1 and c(t)=1, min{∆(t)+z(t),∆max},otherwise. (18) The transition probabilities are subsequently determined using (15) and the following equations: Pb(t+1)b(t), a(t)(19) =         β a(t)=0, b(t+1)=min{b(t)+1,B}, ¯ β a(t)=0, b(t+1)=b(t), β a(t)=1, b(t+1)=b(t), ¯ β a(t)=1, b(t+1)=b(t)−1. P∆(t+1)b(t),∆(t), a(t)(20) =                    pga(t)=0,∆(t+1)=min{∆(t)+1,∆max}, ¯pga(t)=0,∆(t+1)=∆(t), pg¯psa(t)=1,∆(t+1)=min{∆(t)+1,∆max}, ¯pg¯psa(t)=1,∆(t+1)=∆(t), pgpsa(t)=1,∆(t+1)=1, ¯pgpsa(t)=1,∆(t+1)=0. 0 5 10 15 20 0 2 4 6 8 10 12 14 16 Fig. 3: The structure of the optimal update policy. 0.1 0.2 0.3 0.4 0.5 4 6 8 10 12 14 16 Fig. 4: The average VAoI for various policies vs. β. V. NUMERICAL RESULTS The optimal policy for the MDP problem P1is derived using the RVIA. We compare the performance of this policy with two baselines: the Greedy policy, which transmits an update whenever energy arrives and the battery is not empty, and the Randomized Stationary (RS) policy, which transmits with probability αin each time slot, provided the battery is not empty. In all simulations, the system parameters are fixed at N= 64,pg= 0.3,ps= 0.5,B= 20,∆max = 30, and T= 3000, unless stated otherwise. The expected values are averaged over 8000 Monte Carlo iterations. A. The Structure of the Optimal Policy The derived optimal policy is depicted in Fig. 3 for the energy arrival probability β= 0.1. The red circles represent the idle action a= 0, while the blue asterisks indicate the update action a= 1. The optimal policy exhibits a thresholdbased structure, where for each battery state b, the device remains idle until the VAoI at the CS reaches a certain threshold, after which it begins transmitting updates. This highlights an important aspect of semantics-aware information handling schemes: conserving energy for later usage when it is most needed. This is crucial in severe energy-limited scenarios, as early battery depletion at low VAoI causes long update gaps, leading to high VAoI. Conversely, delaying depletion until VAoI is reasonably high mitigates excessive growth. B. The Impact of Energy Arrival Probability (β) Fig. 4 shows the average VAoI as a function of energy arrival probability βfor the optimal, Greedy, and RS policies, 5 0 500 1000 1500 2000 2500 3000 5.4 5.6 5.8 6 6.2 6.4 6.6 6.8 7 7.2 0 10 20 30 40 50 Fig. 5: The impact of Ton the precise and approximate VAoI. considering αvalues of 0.1,0.2, and 0.3. As βincreases, the average VAoI decreases, with the optimal policy performing best by using optimal update thresholds. The performance gap between the optimal and Greedy policies narrows as energy availability increases, converging toward the always update policy. However, for energy-constrained devices with low energy arrival rates, this gap widens, making optimal actions crucial for a fresher, more informative system. In this simulation, the RS policy performs worse than the Greedy policy. Notably, the Greedy policy is a special case of the RS policy with α= 1, meaning that increasing α causes the RS policy to converge toward the Greedy policy, as shown in Fig. 4. When the energy arrival probability is high, energy is more often available. In such cases, the Greedy policy consumes all available energy, while the RS policy with α < 1sometimes skips updates, allowing the battery to store more energy. Consequently, the Greedy policy results in more updates, whereas the RS policy results in fewer. This explains why the RS policy achieves a worse average VAoI. In contrast, when the energy arrival probability is low, long intervals occur between consecutive energy arrivals. During these intervals, both the Greedy policy (transmitting at the first opportunity) and the RS policy (transmitting at a random time slot) deplete the battery, resulting in the same number of updates and similar performance. Remark: An important result here is that to maintain a specific average VAoI in the network, for instance at a level of 8, the optimal policy requires an energy arrival of 0.1, compared to 0.2for the Greedy policy. This indicates that by employing a semantics-aware update policy, the energy consumption of the remote IoT device can be reduced to 50%. The reduction arises from a lower number of updates, which consequently decreases the number of disseminations among satellites. This results in a substantial improvement in energy efficiency, thereby supporting more sustainable energy use and extending the system’s lifetime. C. The Impact of the Time Horizon (T) In Section IV, the optimization problem was formulated under the assumption that T≫N 2. In this section, we analyze the impact of Twhen it does not satisfy this assumption and, consequently, an approximation of VAoI is optimized. The curves corresponding to the precise and approximated average VAoI, given by Equations (6) and (11), respectively, are depicted in Fig. 5. The resulting error is also illustrated as a percentage in red. The curves confirm that when T≫N 2the error becomes negligible. For T≥2N, the error decreases to below 10%, and for T≥10N, it decreases to below 2%. VI. CONCLUSION We developed an optimal update policy to ensure timely and efficient transmission of informative updates from a ground IoT device to a network of interconnected LEO satellites. Within this network, updates are disseminated among nodes arranged in a ring topology. By formulating and optimizing the VAoI across the LEO network, the proposed policy reduces the transmission of stale and irrelevant updates, thereby enhancing energy efficiency. REFERENCES [1] Ntontin et al., “Ether: A 6g architectural framework for 3d multi-layered networks,” in IEEE WCNC, 2024. [2] M. Kountouris and N. Pappas, “Semantics-empowered communication for networked intelligent systems,” IEEE Comm. Mag., vol. 59, no. 6, 2021. [3] S. Kaul, R. Yates, and M. Gruteser, “Real-time status: How often should one update?” in IEEE INFOCOM, 2012. [4] A. Maatouk, S. Kriouile, M. Assaad, and A. Ephremides, “The age of incorrect information: A new performance metric for status updates,” IEEE/ACM Trans. on Networking, vol. 28, no. 5, 2020. [5] R. D. Yates, “The age of gossip in networks,” in IEEE ISIT, 2021. [6] B. Soret, S. Ravikanti, and P. Popovski, “Latency and timeliness in multi-hop satellite networks,” in IEEE ICC, 2020. [7] F. Chiariotti, O. Vikhrova, B. Soret, and P. Popovski, “Age of information in multihop connections with tributary traffic and no preemption,” IEEE Trans. on Comm., vol. 70, no. 10, 2022. [8] Y. Li, Y. Xu, Q. Zhang, and Z. Yang, “Age-optimized multihop information update mechanism on the leo satellite constellation via continuous time-varying graphs,” IEEE IoT Journal, vol. 10, no. 8, 2022. [9] Y. Cai, S. Wu, J. Luo, J. Jiao, N. Zhang, and Q. Zhang, “Age-oriented access control in geo/leo heterogeneous network for marine iort: A deep reinforcement learning approach,” IEEE IoT Journal, vol. 9, no. 24, 2022. [10] Z. Gao, A. Liu, C. Han, and X. Liang, “Non-orthogonal multiple accessbased average age of information minimization in leo satellite-terrestrial integrated networks,” IEEE Trans. on Green Comm. and Networking, vol. 6, no. 3, 2022. [11] J. Huang, J. Jiao, Y. Wang, S. Wu, R. Lu, and Q. Zhang, “Age-critical long erasure coding-ccsds file delivery protocol for dual-hop s-iot,” IEEE IoT Journal, vol. 10, no. 19, 2023. [12] J. Jiao, S. Liu, J. Ding, J. Huang, S. Wu, R. Lu, and Q. Zhang, “Ageoptimal network coding harq transmission scheme for dual-hop satelliteintegrated internet,” IEEE Trans. on Vehicular Technology, vol. 71, no. 10, 2022. [13] Y. Xu, Y. Li, Q. Zhang, and Z. Yang, “Age-optimal hybrid temporalspatial generalized deduplication and arq for satellite-integrated internet of things,” IEEE IoT Journal, vol. 9, no. 24, 2022. [14] H. Hong, J. Jiao, T. Yang, Y. Wang, R. Lu, and Q. Zhang, “Age of incorrect information minimization for semantic-empowered noma system in s-iot,” IEEE Trans. on Wireless Comm., 2023. [15] M. Liao, R. Wang, P. Zhang, and Z. Xian, “Information freshness optimal resource allocation for leo-satellite internet of things,” IEEE IoT Journal, 2024. [16] A. U. Chaudhry and H. Yanikomeroglu, “Laser intersatellite links in a starlink constellation: A classification and analysis,” IEEE vehicular technology mag., vol. 16, no. 2, 2021. [17] Y. Dong, F. Farnia, and A. ¨ Ozg¨ur, “Near optimal energy control and approximate capacity of energy harvesting communication,” IEEE JSAC, vol. 33, no. 3, 2015. [18] E. Delfani and N. Pappas, “Version age-optimal cached status updates in a gossiping network with energy harvesting sensor,” IEEE Trans. on Comm., 2024. [19] M. L. Puterman, Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons, 2014. View publication stats