Stocks making the biggest moves midday: Urban Outfitters, Advance Auto Parts, Snowflake, Sunrun and more
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time Business News
32 minutes ago
- Time Business News
The Definitive 2025 Guide to Data Pipeline Automation: Strategies, Tools & AI Resilience
Data has become the central asset of modern enterprises, driving decision-making, innovation, and operational efficiency. However, the challenge lies in managing, processing, and delivering massive volumes of data across diverse systems—securely, reliably, and in near real time. Data Pipeline Automation has emerged as a critical capability to meet this challenge. By automating data movement, transformation, and orchestration, organizations can ensure consistent data availability without the delays and risks of manual intervention. In 2025, the integration of AI-driven resilience patterns adds a new layer of intelligence to pipeline automation, enabling predictive maintenance, adaptive scaling, and self-healing capabilities. This guide dives deep into strategies, tools, and emerging patterns that define the future of automated data pipelines. Data Pipeline Automation refers to the process of designing, deploying, and maintaining automated workflows that extract, transform, and load (ETL) or extract, load, and transform (ELT) data between systems without manual intervention. Key attributes include: Scheduling and orchestration for regular or event-triggered execution. for regular or event-triggered execution. Error detection and recovery to minimize downtime. to minimize downtime. Scalability to handle fluctuating data loads. to handle fluctuating data loads. Monitoring and alerting to ensure operational transparency. Data Volume Explosion: Global data creation is growing at over 25% annually. Global data creation is growing at over 25% annually. Cloud-Native Architectures: Multi-cloud and hybrid environments require robust orchestration. Multi-cloud and hybrid environments require robust orchestration. Real-Time Analytics Demand: Decision-makers expect live dashboards, not overnight reports. Decision-makers expect live dashboards, not overnight reports. Operational Efficiency: Automated pipelines reduce human errors and operational costs. Data ingestion involves capturing data from multiple sources such as APIs, databases, IoT devices, logs, and streaming platforms. Automated ingestion ensures: Continuous real-time streaming. Batch data transfers on schedule. Handling of structured, semi-structured, and unstructured data. Transformation standardizes and cleanses data for downstream analytics: Schema mapping and data type conversions . and . Data enrichment with reference datasets. with reference datasets. AI-based anomaly detection for data quality improvement. Automated pipelines direct processed data to storage systems: Data warehouses for analytics (e.g., Snowflake, BigQuery). Data lakes for raw, unstructured data. Lakehouse architectures for combined flexibility. Orchestration coordinates tasks, dependencies, and execution logic: Dependency resolution between ETL jobs. Failure handling and retries. Dynamic task scheduling based on triggers. Breaking pipelines into reusable modules allows teams to: Update components independently. Reduce maintenance complexity. Scale specific pipeline parts without affecting others. Instead of fixed schedules, event-driven triggers initiate pipelines when: New files arrive in cloud storage. Database tables are updated. IoT sensors generate new data. Defining pipeline configurations as code ensures: Version control for reproducibility. Easy deployment across environments. Rapid rollback in case of issues. Integration of automated testing into pipelines ensures: Schema validation before ingestion. Unit tests for transformation logic. Performance benchmarks for scalability. The 2025 era of Data Pipeline Automation introduces AI-based resilience techniques to enhance reliability. Machine learning models monitor logs and metrics to: Predict hardware or network failures. Alert teams before critical breakdowns. Trigger failover to backup systems. Automated remediation workflows: Restart failed jobs. Switch to alternative data sources. Automatically adjust resource allocation. AI models adjust processing capacity based on: Historical usage patterns. Anticipated data spikes (e.g., holiday seasons). SLA compliance requirements. AI detects anomalies in: Data freshness. Outlier detection in numerical data. Missing or inconsistent values. While the underlying principles remain, the tools have evolved with enhanced automation, AI integration, and cloud compatibility. Apache Airflow (with AI-powered DAG optimization) Prefect Orion Dagster Apache Kafka with auto-rebalancing consumers. AWS Kinesis with predictive scaling. Google Pub/Sub with anomaly-aware delivery. dbt (Data Build Tool) with ML-based transformation testing. Fivetran with adaptive scheduling. Talend Cloud with AI-powered data matching. OpenTelemetry pipelines for unified logging. AI-driven APM (Application Performance Monitoring) dashboards. Security is not an afterthought—automation must be coupled with compliance: Data encryption in transit and at rest. in transit and at rest. Role-based access control (RBAC) for pipeline components. for pipeline components. Automated compliance audits for GDPR, HIPAA, and PCI-DSS. Data latency (time from source to destination). (time from source to destination). Failure rate per pipeline run. per pipeline run. Mean Time to Recovery (MTTR) . . Cost per GB processed. Regular review of data transformations. AI-powered workload distribution. Capacity planning based on predictive analytics. Serverless Pipeline Architectures: Fully managed pipelines with zero infrastructure overhead. Fully managed pipelines with zero infrastructure overhead. Generative AI in Pipeline Design: Automated code generation for transformations. Automated code generation for transformations. Data Contracts: Formal agreements between producers and consumers to ensure reliability. Formal agreements between producers and consumers to ensure reliability. Edge Data Processing: Running pipelines close to IoT devices for real-time responsiveness. In 2025, Data Pipeline Automation is no longer a 'nice-to-have' but a critical enabler of competitive advantage. With AI-driven resilience patterns, businesses can ensure continuous, scalable, and reliable data flow across their digital ecosystems. Those who invest in modular architecture, event-driven triggers, and adaptive AI capabilities will not only streamline operations but also unlock new levels of innovation and decision-making speed. Q1. What is the difference between manual and automated data pipelines? Manual pipelines require human intervention for data movement and transformation, while automated pipelines operate on predefined schedules or events, ensuring consistency and reducing errors. Q2. Can AI completely replace human oversight in pipeline management? Not entirely. AI can handle prediction, scaling, and self-healing, but human oversight remains essential for strategic decisions, compliance checks, and exception handling. Q3. How does Data Pipeline Automation reduce costs? It minimizes manual labor, prevents downtime, optimizes resource utilization, and reduces the cost of fixing data errors. Q4. Is Data Pipeline Automation suitable for small businesses? Yes. Cloud-based tools allow small businesses to start with minimal infrastructure investment and scale as data needs grow. Q5. What is the role of event-driven triggers in pipeline automation? They ensure that pipelines run only when necessary, improving efficiency and reducing unnecessary compute costs. TIME BUSINESS NEWS
Politico
an hour ago
- Politico
Sherrod Brown's never-ending crypto headache
Editor's note: Morning Money is a free version of POLITICO Pro Financial Services morning newsletter, which is delivered to our subscribers each morning at 5:15 a.m. The POLITICO Pro platform combines the news you need with tools you can use to take action on the day's biggest stories. Act on the news with POLITICO Pro. Quick Fix Remember the Senate Banking Committee of 2022? The cryptocurrency industry — then beleaguered by scandals, lawsuits, and unfriendly lawmakers — doesn't want to. And crypto firms may again drop a bomb of super PAC money on Ohio to keep it from coming back. As your host reports in a new story out this morning, crypto campaign cash is looming over former Banking Chair Sherrod Brown's Senate comeback bid in the Buckeye State. A deep-pocketed super PAC funded by crypto companies that spent more than $40 million to help defeat Brown during his failed 2024 re-election campaign could once again pose a major problem for the Ohio Democrat as he seeks to return to the Senate in next year's midterms. Defeating Brown, a longtime thorn in the side for both Wall Street and the crypto sector who was a big roadblock to industry-friendly digital asset legislation as chair of the committee, was the biggest win last year for the crypto PAC network, known as Fairshake. Its 2024 crusade featured more than $130 million in spending across a swath of House and Senate races, which helped turn around the industry's fortunes in Washington. The PAC network has replenished its war chest with more than $140 million ahead of 2026, and it is already signaling that Brown could again be a target. 'Last year, voters sent a clear message that the Sherrod Brown and Elizabeth Warren agenda was deeply out of touch with Ohio values,' Fairshake spokesperson Josh Vlasto said in a statement. 'We will continue to support pro-crypto candidates and oppose anti-crypto candidates, in Ohio and nationwide.' As chair of the banking panel from 2021 to 2025, Brown often warned that digital assets open the door to illicit finance and money laundering, and he stood in the way of GOP-led proposals aimed at boosting the sector. Crypto firms capitalized on his political vulnerability in 2024, when he was one of only two Democratic incumbents running in states won by President Donald Trump. Fairshake — which is funded primarily by the crypto firms Coinbase and Ripple and the venture capital group Andreessen Horowitz — spent more money on his Ohio race than any other contest it meddled in. The PAC plastered ads across the state boosting Republican Bernie Moreno, a crypto enthusiast and car dealer who defeated Brown and now sits on the banking panel himself. It is unclear if Brown would retain his seniority and replace Warren as the committee's Democratic leader. Senate Democrats' current rules stipulate that seniority is defined by a member's most recent entry into the conference, meaning that 'the seniority of a Member with interrupted service or service in another Party does not date from that Member's initial entrance into the Senate.' But Democratic leaders could seek to change those rules or grant an exception to Brown, who was their top recruit for the Ohio race. Regardless, crypto lobbyists worry that Brown could pose problems for them if he returns — especially given the brute-force tactics the industry has used to try to take him out. And his opponent, Republican Jon Husted, has been a reliably industry-friendly vote. Husted campaign spokesperson Tyson Shepard said in a statement that if Brown enters the race, 'he will be starting in the biggest hole of his political career,' dubbing him Senate Minority Leader Chuck Schumer's 'handpicked candidate.' Ohio Democrats hope a more favorable national environment will help propel Brown next year. 'Crypto can come in again and do whatever they're going to do,' said Jerry Austin, a longtime Democratic strategist in the state. 'I think they've shot their wad. And if they want to come back and do it again, I think a lot of things have happened between the last election and now, and that is what Trump's been doing in Ohio and the rest of the country.' It's THURSDAY — Send Capitol Hill tips to jgoodman@ For econ policy thoughts, Wall Street tips, personnel moves or general insights, email Sam at ssutton@ Driving the day Labor will release the Producer Price Index for July at 8:30 a.m. … The Securities and Exchange Commission has a closed meeting at 1 p.m. … Rate cut watch — Treasury Secretary Scott Bessent suggested the Federal Reserve should cut interest rates by half a percentage point when it meets next month, Bloomberg reports. 'I think we could go into a series of rate cuts here, starting with a 50 basis-point rate cut in September,' Bessent said on Bloomberg TV. 'Any model,' he said, suggests 'we should probably be 150, 175 basis points lower.' New York v. Zelle — New York Attorney General Letitia James on Wednesday sued the operator of Zelle, accusing the bank-owned payment platform of facilitating widespread fraud and failing to protect consumers, our Michael Stratford writes. The lawsuit against Early Warning Services, which runs the popular peer-to-peer payment network, revives similar allegations that were dropped earlier this year by the Trump administration's Consumer Financial Protection Bureau. A Zelle spokesperson said New York's lawsuit was a 'political stunt to generate press, not progress.' ICYMI — Why Trump's BLS pick is in for a fight, via Sam Sutton and Nick Niedzwiadek At the regulators Treasury waives sanctions for Trump-Putin summit — The Treasury Department is temporarily easing its sweeping sanctions program targeting Russia to allow activities needed to carry out Trump's historic meeting with Russian President Vladimir Putin in Alaska on Friday. The order, signed on Wednesday, underscores the complex logistics involved in hosting Putin and other Russian officials who are cut off from the U.S. financial system. Treasury greenlit transactions that would otherwise be prohibited if they're 'ordinarily incident and necessary to the attendance at or support of meetings' in Alaska between the U.S. and Russian governments. The reprieve lasts through Aug. 20, and it explicitly prohibits the unblocking of any frozen Russian assets or other property. On The Hill Strange bedfellows — A coalition of groups that are normally on opposing sides in financial regulatory policy fights is calling on lawmakers to change a section of the recently enacted stablecoin law that it says allows state-chartered uninsured depository institutions to operate nationwide without proper supervision. A letter sent to lawmakers on the Senate Banking Committee Wednesday led by the Conference of State Bank Supervisors said the GENIUS Act 'allows any state-chartered uninsured depository institution with a stablecoin subsidiary to perform traditional (i.e., not solely related to payment stablecoins) money transmission and custody activities nationwide through that subsidiary, thereby bypassing host state licensing and allowing substantially less state oversight.' The letter was signed by bank trade associations including the American Bankers Association and consumer groups including Americans for Financial Reform. 'This unprecedented overriding of state law and supervision weakens vital consumer protections, creates opportunities for regulatory arbitrage, and undermines state sovereignty,' the letter said. Outbound investment on the big stage –– From our Katherine Hapgood: House Financial Services National Security Subcommittee Chair Warren Davidson (R-Ohio) said Wednesday that as Congress considers their proposal for the Defense Production Act, they will have to wait on a potential outbound investment addition, as it will most likely be a part of Trump's trade negotiations with China. 'We have a strong sense from the administration, they would rather have a threat of very harsh outbound investment criteria than finished outbound investment criteria, because they're also hopeful for a positive outcome in the negotiations,' Davidson told Katherine after the subcommittee's field hearing on the DPA. Davidson said he also wants to decouple the legislation from the annual appropriations deadline for 'more floor time' to modernize the DPA, and let trade negotiations play out. He said he is eyeing June for the revamped DPA reauthorization. Bessent endorses congressional stock trading ban — Treasury Secretary Scott Bessent is calling for a ban on single-stock trading by members of Congress, our Gregory Svirnovskiy and Meredith Lee Hill write. Trade Bessent dismisses Nvidia deal concerns — Bessent on Wednesday brushed off concerns about Trump's decision to charge Nvidia for a government license to export semiconductor chips to China, our Doug Palmer and Ari Hawkins report. 'There are no national security concerns here' because the H20 chips are not the most advanced chips that Nvidia makes, Bessent said in an interview on Bloomberg Television. His comments come despite criticism from former officials and members of Congress. Jobs report Anastasia Dellaccio is joining the Digital Chamber, a crypto trade group, as executive director of state and regional affairs. She is an alum of the Export-Import Bank.
NBC News
an hour ago
- NBC News
Trump's unusual approach to business and mediation ordered in Ohio State lawsuits: Morning Rundown
Trump takes an unprecedented approach to corporate affairs. Arab states stay quiet while other nations around the world decry the conditions in Gaza. And a woman's viral saga about falling in love with her psychiatrist spurs an existential question about AI chatbots. Here's what to know today. As the CEO in chief, Trump gets what he wants from companies Donald Trump has controlled his own businesses for decades. Now, as president, he's taking an increasingly active role in individual corporations' affairs — and several of them are meeting his demands. This represents a break with past administrations that may have been unwilling or unable, politically, to bring similar pressure to bear on businesses. Even some of Trump's opponents see the appeal of his efforts. In the past few months, Coca-Cola said it would produce soda with cane sugar in the U.S. Two major semiconductor makers agreed to give the government a cut of their sales to China. And Paramount paid millions to settle allegations Trump levied against CBS' '60 Minutes,' days before the administration approved the media conglomerate's merger with Skydance Media. This is Morning Rundown, a weekday newsletter to start your day. Sign up here to get it in your inbox. Trump also hasn't shied away from making explicit warnings. In the past week alone, he called for Lip-Bu Tan, the CEO of chipmaker Intel, to step down (though reversed course days later after a White House visit) and said Goldman Sachs should fire its chief economist because of the company's bearishness on his tariffs. 'It's so much different than the first time,' said a Republican lobbyist whose firm represents several Fortune 500 companies, of how Trump's actions differ from his first term. 'He's just acting like a businessman.' A progressive strategist who said he 'disagrees with the guy on almost every issue' concedes that Democrats could take a page out of Trump's strategy and 'adapt to the changing presidency' to take on corporations. The fear of reprisals has firms making strategic decisions to forgo any kind of legal challenge to his methods. Over the longer term, Ryan Bourne, a chair at the libertarian think tank the Cato Institute, predicts Trump's antics could give way to a less efficient economy. 'Where it can lead is businesses, rather than focusing on creating value, now seek to play footsie with politicians more and more,' Bourne said. Read the full story here. More politics news: Trump announced this year's host of the Kennedy Center Honors ceremony: himself. But, he insisted, 'I didn't want to do it. OK?' As Trump's directive to crack down on Washington, D.C., crime moves forward, a new law enforcement checkpoint goes up in a bustling neighborhood. Trump does not intend to discuss any possible divisions of land during his meeting tomorrow with Russian President Vladimir Putin, he told European leaders on a call yesterday. A new ICE detention facility set to open in Texas offers a preview of the problems that may arise as the Trump administration ramps up mass deportations. E.J. Antoni, Trump's pick to lead the Bureau of Labor Statistics, was a 'bystander' at the U.S. Capitol during the Jan. 6 riot, social media footage shows. The dozens of Democratic legislators who fled Texas amid a redistricting fight are charting a plan for what comes next as the state's first special legislative session winds down. Why Arab rulers aren't more vocal about Gaza With deaths from starvation and Israeli bombardment mounting in Gaza, countries around the world have become more vocal in criticizing Israel for its conduct and pledging to recognize a Palestinian state. But Arab states have notably been much less vocal, leaving Palestinians, their supporters and some analysts angry. 'The Arabs are napping,' said Fawaz Gerges, a professor of international relations at the London School of Economics, adding that leaders 'have buried their heads in the sand.' There have been small signs of support. For example, Arab states have participated in airdrops of aid and food convoys into Gaza, but Palestinians say it's nowhere near enough to ward off a looming famine; and Egypt and Qatar have mediated talks between Israel, Hamas and the U.S., but they have not led to an end to the conflict. Experts say Gulf Arab states' ties with Israel have more to do with politics than public attitudes. Several states host U.S. military bases that analysts say help shield them from regional rival Iran. And access to Israel's tech sector has been a draw for some states. Meanwhile, the U.S. and Israel have floated plans for Arab countries to accept Gaza refugees. But fearing renewed Palestinian militancy and accusations of aiding ethnic cleansing, these Arab nations have rejected the idea. Read the full story here. Mediation ordered for Ohio State over sex abuse lawsuits Ohio State University has been ordered to resolve via mediation the remaining lawsuits filed by former students who claim that Dr. Richard Strauss molested them, mostly under the guise of giving physicals, while he was a school employee from the mid-1970s to the late 1990s. The university still faces five active lawsuits from 236 men alleging the school failed to protect them. U.S. District Judge Michael H. Watson issued the mediation order on Monday and referred the cases to Layn Phillips, who mediated the lawsuits filed against Michigan State by some 200 women athletes who were sexually abused by sports doctor Larry Nassar. An independent investigation in 2019 concluded that Strauss sexually abused at least 177 male athletes and students, and that coaches and administrators knew about it for two decades but failed to stop him. The university said it has paid out $60 million in settlement money already. Read the full story here. Read All About It Taylor Swift teared up during a podcast interview with her boyfriend (and his brother), chatting about her upcoming album, the start of their relationship, getting the master recordings for her music and more. A company that proposed a $30 billion data center on land owned by the widow of NASCAR champion Dale Earnhardt in rural North Carolina will not move forward with the project after intense backlash. ICE allegedly sent three children, including a boy with Stage 4 cancer, to Honduras with their deported mothers despite the moms' claims they wanted to stay in the U.S., according to a lawsuit. A man accused of faking his own death and fleeing the U.S. to avoid sexual assault and fraud allegations has been convicted of rape in Utah. A woman searched an Arkansas state park for a diamond for her engagement ring. On her very last day, she hit the jackpot. As AI chatbots become a regular tool in people's lives, recent incidents have put a renewed spotlight on how the people-pleasing nature of these bots can influence users' sense of reality. For Kendra Hilty, a TikTok user whose saga about falling in love with her psychiatrist has gone viral, her chatbots are like confidants. But 'I do my best to keep them in check,' she told me in an email this week. Still, stories such as Hilty's are sparking widespread discourse about the use of AI chatbots for validation, which is why I explored mental health experts' rising concerns about AI-fueled delusions, as well as how tech companies have struggled to combat the issue. — Angela Yang, culture & trends reporter NBC Select: Online Shopping, Simplified Arch pain, shin splints and other common issues while running can be alleviated with insole or shoe insert. Here's what podiatrists recommend. And don't let zits bum you out. The NBC Select team spoke to dermatologists about the best way to get rid of butt acne. here.
